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Abstract. The relative position of one subfactor of a factor has 
been proved quite rich since the work of Jones. We shall show that 
the theory of relative position of several subspaces of a separable 
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1. Introduction 

The relative position of one subfactor of a factor has been proved 
quite rich since the work of Jones [J] . On the other hand, the relative 
position of one subspace of a Hilbert space is extremely simple and de- 
termined by the dimension and the co-dimension of the subspace. But 
we shall show that the theory of relative position of several subspaces 
of a Hilbert space is rich as subfactor theory. 

It is a well known fact that the relative position of two subspaces E 
and F in a Hilbert space H can be described completely up to unitary 
equivalence as in Araki |Arj Dixmier [Dj and Halmos |Halj . The Hilbert 
space is the direct sum of five subspaces: 

H ={Er]F)® (the rest) ©(En F^) © {E^ n F) © {E^ f] F^). 

In the rest part, E and F are in generic position and the relative 
position is described only by "the angles" between them. 

We disregard "the angles" and study the still-remaining fundamental 
feature of the relative position of n subspaces. As it is important to 
study irreducible subfactors in subfactor theory, we should study an 
indecomposable system of n subspaces in the sense that the system can 
not be isomorphic to a direct sum of two non-zero systems. 



On the other hand, many problems of hnear algebra can be reduced 
to the classification of the systems of subpaces in a finite-dimensional 
vector space. In a finite-dimensional space, the classification of inde- 
composable systems of n subspaces for n = 1, 2 and 3 was simple. Jor- 
dan blocks give indecomposable systems of 4 subspaces. But there exist 
many other kinds of indecomposable systems of 4 subspaces. Therefore 
it was surprising that Gelfand and Ponomarev ;GP] gave a complete 
classification of indecomposable systems of four subspaces in a finite- 
dimensional space over an algebraically closed field. 

In this note we study relative position of n subspaces in a separa- 
ble infinite-dimensional Hilbert space. The fact that the sum of closed 
subspaces is not necessary closed causes some troubles in several ar- 
guments in Gelfand-Ponomarev jGPj . Let if be a Hilbert space and 
El, . . . Enhe n subspaces in H. Then we say that S = {H; Ei, . . . , En) 
is a system of n subspaces in if or a n-subspace system in if. A system 
S is called indecomposable if S can not be decomposed into a nontriv- 
ial direct sum. For any bounded linear operator A on a Hilbert space 
K, we can associate a system Sa of four subspaces in ii" = i^ © i^ by 

Sa = {H;K ® 0,0® K, graph A, {{x,x);x G K}). 

Two such systems Sa and Sb are isomorphic if and only if the two 
operators A and B are similar. The direct sum of such systems cor- 
responds to the direct sum of the operators. In this sense the theory 
of operators is included into the theory of relative positions of four 
subspaces. In particular on a finite dimesional space, Jordan blocks 
correspond to indecomposable systems. Moreover on an infinite di- 
mensional Hilbert space, the above system Sa is indecomposable if and 
only if A is strongly irreducible, which is an infinite-dimensional analog 
of a Jordan block, see, for example, a monograph by Jiang and Wang 
|JWj . Therefore there exist uncountably many indecomposable sys- 
tems of four subspaces. But it is rather difficult to know whether there 
exists another kind of indecomposable system of four subspaces. One 
of the main result of the paper is to give uncountably many, exotic, 
indecomposable systems of four subspaces on an infinite-dimensional 
separable Hilbert space. The £^-boundedness is crucially used. 

Gelfand and Ponomarev introduced an integer valued invariant p{S), 
called defect, for a system S = (ii; Ei, E2, E3, E4) of four subspaces by 

4 

p{S) = ^ dim - 2 dim H. 

i=l 

We extend the defect to a certain class of systems of four subspaces 
on an infinite dimesional Hilbert space using Fredholm index. We 
believe that there exists an analogy between a classification of sys- 
tems of subspaces and a classification of subfactors, and the defect by 
Gelfand and Ponomarev seems to correspond to the index by Jones 
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[j]. Therefore the determination of possible value of defect is also im- 
portant. If a pair iV C M of factor-subfactor is finite-dimensional, 
then Jones index [M : A^] is an integer. But if C M is infinite- 
dimensional, then Jones index [M : A^] is a non-integer in general. One 
of the amazing fact was that the possible value of Jones index is in 
{4 cos^ ^ I n = 3, 4, ...}U [4, cxd]. We show that a similar situation occurs 
for the possible value of defect. If a system S = {H; Ei, E2, E3, E^) of 
four subspaces is finite-dimensional, then the defect p{S) is an integer. 
Gelfand and Ponomarev showed that the possible value of defect p{S) 
is exactly in {— 2,— 1,0,1,2}. We show that the set of values of defect 
for indecomposable systems of four subspaces in an infinite-dimesional 
Hilbert spaces is exactly {f ; ^ G Z}. 

We extend Coxeter functors after Gelfand- Ponomarev and show that 
the Coxeter functors preserve the defect and indecomposabihty under 
certain conditions. 

Halmos initiated the study of transitive lattices and gave an example 
of transitive lattice consisting of seven subspaces in |Ha2j . Harison- 
Radjavi- Rosenthal |HR,R,j constructed a transitive lattice consisting 
of six subspaces using the graph of an unbounded closed operator. 
Hadwin-Longstaff- Rosenthal found a transitive lattice of five non-closed 
linear subspaces in |HLRj . Any finite transitive lattice which consists 
of n subspaces of a Hilbert space H gives an indecomposable system 
of n — 2 subspaces by withdrawing and H, but the converse is not 
true. It is still unknown whether or not there exists a transitive lattice 
consisting of five subspaces. Therefore it is also an interesting prob- 
lem to know whether there exists an indecomposable system of three 
subspaces in an infinite-dimensional Hilbert space. 

Throughout the paper a projection means an operator e with = 
e = e* and an idempotent means an operator p with = p. 

Sunder also considered n subspaces in jH]. But his interest is ex- 
tremely opposite to ours. In fact he studied the decomposable case 
such that the Hilbert space H is an algebraic sum of the n subspaces. 
He solved the statistical problem of computing the canonical partial 
correlation coefficients between three sets of random variables. 

When we announced some part of our result in US- Japan seminar 
at Fukuoka in 1999, we had not yet known the notion and interest- 
ing works on strong irreducible operators which are summarized in a 
monograph by Jiang and Wang ^JWJ . 

There seems to be interesting relations with the study of represen- 
tations of *-algebras generated by idempotents by S. Kruglyak and Y. 
Samoilenko |KSj and the study on sums of projections by S. Kruglyak, 
V. Rabanovich and Y. Samoilenko |KRSj . But we do not know the 
exact implication, because their objects are different with ours. 

In finite dimensional case, the classification of four subspaces is 
described as the classification of the representations of the extended 
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Dynkin diagram . Recall that Gabriel [0] listed Dynkin diagrams 
An, Dn, Eq,Et, Eg in his theory on finiteness of indecomposable repre- 
sentations of quivers. We will discuss on indecomposable representa- 
tions of quivers on infinite- dimensinal Hilbert spaces somewhere else 
|EWj as a continuation of this paper. 

In purely algebraic setting, it is known that if a finite-dimensional 
algebra R is not of representation-finite type, then there exist indecom- 
posable i?-modules of infinite length as in M. Auslander |Auj . Since we 
consider representations on Hilbert spaces, the result in |Auj cannot 
be applied directly. We need several techniques in functional analysis. 
See a book |KRj for infinite length modules. 

The authors are supported by the Grant-in-Aid for Scientific Re- 
search of JSPS. 

2. SYSTEMS OF n SUBSPACES 

We study the relative position of n subspaces in a separable Hilbert 
space. Let if be a Hilbert space and Ei, . . . En he n subspaces in H. 
Then we say that S = (if; Ei, . . . , En) is a system of n-subspaces in 
if or a n-subspace system in if. Let T = {K; Fi, . . . , i^„) be another 
system of ra-subspaces in a Hilbert space K. Then : S —y T is 
called a homomorphism if : H —>■ K is a. bounded linear operator 
satisfying that (p{Ei) C Fj for z = 1, . . . , n. And ip : S T is called 
an isomorphism if y9 : if i^ is an invertible (i.e., bounded bijective) 
linear operator satisfying that f{Ei) = Fi for i = 1, . . . ,n. We say that 
systems S and T are isomorphic if there is an isomorphism (f : S ^ T. 
This means that the relative positions of n subspaces {Ei, . . . , En) in if 
and (Fi, . . . , F„) in K are same under disregarding angles. We say that 
systems S and T are unitarily equivalent if the above isomorphism 
ip : H ^ K can be chosen to be a unitary. This means that the 
relative positions of n subspaces (£"1, . . . , En) in if and (Fi, . . . , F„) in 
K are same with preserving the angles between the subspaces. We are 
interested in the relative position of subspaces up to isomorphims to 
study the still-remaining fundamental feature of the relative position 
after disregarding "the angles" . 

We denote by Hom{S, T) the set of homomorphims of 5 to T and 
End{S) := Hom{S,S) the set of endomorphisms on S. 

Let G2 = Z/2Z * Z/2Z = (01,02) be the free product of the cyclic 
groups of order two with generators ai and 02. For two subspaces Ei 
and E2 of a Hilbert space if, let Ci and 62 be the projections onto Ei 
and E2. Then ui = 2ei — i and U2 = 2e2 — i are self-adjoint unitaries. 
Thus there is a bijective correspondence between the set Sys^{H) of 
systems S = {H; Ei, E2) of two subspaces in a Hilbert space if and 
the set Rep{G2, if) of unitary representations vr of G2 on if such that 
7r(ai) = Ml and 71(02) = U2- Similarly let G„ = Z/2Z * ... * Z/2Z be 
the n-times free product of the cyclic groups of order two. Then there 
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is a bijective correspondence between the set Sys"'{H) of systems of 
n subspaces in a Hilbert space H and the set Rep{Gn, H) of unitary 
representations on H oi Gn on H. It is well known that if n > 3, 
then the group Gn is non-amenable. We should be careful that even if 
two systems of n subspaces are isomorphic, the corresponding unitary 
representations are not necessary to be similar, although the converse 
is always true. 

Example 1 Let if = C^. Fix an angle with O<0 <'k/2. Put = 

C(1,0) and E2 = C{cos6 , sin6) . Then Si = {H; Ei, E2) is isomorphic 
to ^2 = (C^; C©0, 0©C). But the corresponding two unitary represen- 
tations TTi and 712 are not similar, because i(7ri(ai)-|-l)|(7ri(a2)-l-l) 7^ 
and l{7T2{ai) + I)|(7r2(a2) + 1) = 0. 

We start with a known fact to recall some notation. 

Lemma 2.1. Let H be a Hilbert space and Hi and H2 be two subspaces 
of H. Then the following are equivalent: 

(1) H = H1 + H2 and HinH2 = 0. 

(2) There exists a closed subspace M G H such that {H; Hi, H2) is 
isomorphic to (if; M, M-*-) 

(3) There exists an idempotnet P e B{H) such that Hi — ImP 
and H2^1m{l- P). 

Proof. The equivalence between (1) and (3) is trivial and it is imme- 
diate that (2)^(1) . We show that (1)^(2). Assume (1) and put 

M = Hi. Let ei be the (orthogonal) projection onto Hi. Let P be 
the idempotent onto iii along ii2, so that P^ = ^i for = ^1 + ^2, 
(^1 G Hi, ^2 G ii2). Define an operator T : H ^ H hj T^ — 
pI + {I - ei)(i - P)^ for C & H. The operator P, T and T'^ are 
also writen as operator matrices 

under the decomposion H = Hi®H^. Thus T is an invertible bounded 
linear operator satisfying THi = Hi and TH2 = H^. Hence T gives 
an isomorphism. □ 

Lemma 2.2. Let H and K be Hilbert spaces and E C H and F d K 
be closed subspaces of H and K. Let e G B{H) and f G B{K) be the 
projections onto E and F. Then the following are equivalent: 

(1) There exists an invertible operator T : H ^ K such that 
T{E) = F. 

(2) There exists an invertible operator T : H ^ K such that e = 
{T-^fT)e andf = {TeT-^)f. 

Proof. (l)=^(2):Assume there exists an invertible operator T : H ^ K 
such that T{E) = F. Then for any ^ G ii, Te(C) G T{E) = F. Hence 
/(re(0) = Te{C). Thus T'^fTe = e. Similarly we have / = TeT'^f. 
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(2) (1): Assume (2). For ^ e E, T(0 = Te(0 = /Te(0 G F. Thus 
T{E) C F. Similarly T-^{F) C E. Hence F C r(E). Therefore 
T{E) = F. □ 

Using the above lemma, we can describe an isomorphism between 
two systems of n suspaces in terms of operators only as follows: 

Corollary 2.3. Let S ^ {H;Ei,--- , E^) and S' = {H'; E[,--- ,E'J 
be two systems of n-subspaces. Let Ci (resp. e'J be the projection onto 

Ei (resp. E[) . Then two systems S and S' are isomorphic if and 
only if there exists an invertible operator T : H ^ H' such that Ci — 
{T~^e'jT)ei and = {TeiT^^)e[ for i = 1, . . . ,n. 

Remark. If there exists an invertible operator T : H ^ H' such that 
= TciT^^ for i = 1, . . . , n, then two systems S and S' are isomorphic. 

But the converse is not true as in example 1. 

We often want to disregard the order of the subspaces. 

Definition Let S = {H;Ei,--- , E„) and S' = {H';E[,--- ,E'J be 
two systems of n-subspaces. Then we say that S and S' are iso- 
morphic up to a permutation of subspaces if there exists a permu- 
tation (T on {1, 2, ... , n} such that 0"(iS) := {H; Ea-(i), ■ • • , Ea-(n)) and 
S' = {H'] E[, ■ ■ ■ ,E'^) are isomorphic, i.e., there exists a bounded 
invertible operator (p : H ^ H' satisfying that ip{E„{i)) = E[ for 
i = 1, . . . , n. 

3. INDECOMPOSABLE SYSTEMS 

In this section we shall introduce a notion of indecomposable system, 
that is, a system which cannot be decomposed into a direct sum of 
smaller systems anymore. 

Definition (direct sum) Let S = {H; Ei, . . . , E,,) and S' = {H'; E[,--- ,E'^) 
be systems of n subspaces in Hilbert spaces H and H'. Then their di- 
rect sum <S ® <S' is defined by 

S®S' -.^{H® H'- Ei®E[,...,En(B K). 

Definition(indecomposable system) A system S = {H; Ei, . . . , En) of 
n subspaces is called decomposable if the system S is isomorphic to a 
direct sum of two non-zero systems. A system S = {H; Ei, - ■ ■ , E^) is 
said to be indecomposable if it is not decomposable. 

Example 2. Let H = C^. Fix an angle 9 with < 9 < 7r/2. Put 
El = C(1,0) and E2 = C{cos9, sin9). Then {H; Ei, E2) is isomorphic 
to 

(C'; C ® 0, © C) ^ (C; C, 0) © (C; 0, C). 

Hence {H;Ei,E2) is decomposable. 
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Remark. Let ei and 62 be the projections onto Ei and E2 in the exam- 
ple 2 above. Then the C*-algebra C*({ei,e2}) generated by ei and 62 
is exactly B{H) ^ M2(C). Therefore the irreducibility of C*({ei,e2}) 
does not imply the indecomposability of {H; Ei, E2). Thus seeking an 
indecomposable system of subspaces is much more difficult and funda- 
mental task than showing irreducibility of the C*-algebra generated by 
the corresponding projectios for the subspaces. 

We can characterize decomposability of systems inside the ambient 
Hilbert space. 

Lemma 3.1. Let H be a Hilbert space and S = {H; Ei, . . . , En) a 

system of n subspaces. Then the following condition are equivalent: 

(1) S is decomposable. 

(2) there exist non-zero closed subspaces Hi and H2 of H such that 
Hi + H2 = H, HinH2 = and Ei = Ei n Hi + E, n H2 for 
i = 1, . . . ,n. 

Proof (1)^ (2): It is trivial. (2)^ (1): Assume (2). By EH there 
exist a closed subspace M G H {in fact we can choose M = Hi) and an 
invertible operator T G B{H) such that T{Hi) = M and T{H2) = M^. 
Then S is isomorphic to a direct sum 

(M; T{Ei nHi),..., T{En nHi))® (M^; T{Ei nH2),..., T{En H H2)). 

□ 

We give a condition of decomposability in terms of endomorphism 
algebras for the systems. 

Lemma 3.2. Let H be a Hilbert space and S = {H; Ei, . . . , En) a 

system of n subspaces in H . Let Cj be the projection onto Ei. Then the 
following are equivalent: 

(1) There exist non-zero closed subspaces Hi,H2 C H such that 
H = Hi + H2, HinH2 = (0) and Ei = Ei n Hi + E, n H2, 
{i = l,...,n). 

(2) There exists a non-trivial idempotent R G B{H) such that 
R{Ei)cEi, (2 = l,...,n). 

(3) There exists a non-trivial idempotent R G B{H) such that 
CiRci = Rci, {i = 1,. . .,n) . 

Proof. (1) =^ (2): Assume (1). Let R be the idempotent onto Hi along 
H2. For any & Ei, there exist ^1 G Ei H Hi and ^2 ^ Ei H H2 such 
that ^ = 6 + 6- Then R{C) = ^1 G Ei. Thus R{Ei) C Ei. 
(2) ^(1): Assume (2). We put Hi = lmR and H2 = Im(J - R). For 
C G Ei, we have ^ = R{C) + (/ - R){0- Since R{Ei) C Ei, R{^) G Ei. 
Then (/ -R){^)=^- R{^) G Ei. Thus Ei G Ei^ Hi + EiH H2. The 
other inclusion "d" is trivial. (2) ^ (3) : It is trivial. □ 
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We put Idem{S) := {T G End{Sy, T = T^}. 



Corollary 3.3. Let S = {H; Ei, . . . , En) be a system of n subspaces in 
a Hubert space H . Then S is indecomposable if and only if Idem{S) = 
{0,1}. 

Corollary 3.4. Let S = {H; Ei, . . . , En) be a system of n subspaces in 
a Hubert space H . Let Cj be the projection of H onto Ei fori = 1, . . . , n. 
If S = {H; El, . . . , En) is indecomposable, then the C*({ei, . . . , e„}) 
generated by Ci, . . . , Cn is irreducible. But the converse is not true. 

Corollary 3.5. Let S = {H; Ei, . . . , En) be a system of n subspaces in 
a Hubert space H . Let Cj be the projection of H onto Ei fori = 1, . . . ,n. 
Let P be a closed subspace of H and p the projection of H onto P. If 
p commutes with any Ci, then 

Ei = Ei nP + Ei n P^ 

Proof. The projection R of H onto P satisfies the condition (3) in 
EH □ 

Definition. Let S = {H; Ei, . . . , En) be a system of n subspaces in a 
Hilbert space H. Let e, be the projection of H onto E^ for i = 1, . . . ,n. 
We say that 5 is a commutative system if the C*({ei, . . . , e„}) gener- 
ated by ei, . . . , e„ is commutative. Be carefull that commutativity is 
not an isomorphic invariant as shown in Example 1. But it is mean- 
ingful that a system is isomorphic to a commutative system. 

Proposition 3.6. Let S = {H; Ei, . . . , En) be a system of n subspaces 
in a Hilbert space H. Assume that S is a commutative system. Then S 
is indecomposable if and only if dim H = 1. Moreover each subset A C 
{1, . . . ,n} corresponds to a commutative system satisfying dim Ei = 1 
for i G A and dim Ei = for i ^ A. 

Proof. Let Cj be the projection of H onto Ei for i = 1, . . . ,n. If 5 is 
a commutative, indecomposable system, then the C*({ei, . . . , e„}) C 
B[H) is commutative and irreducible. Thus dim if = 1. The converse 
and the rest is clear. □ 

Example 3. Let H = C^. Put Ei = C(1,0), E2 = C(0, 1) and E3 = 
C(l, 1). Then S = {H; Ei, E2, E3) is indecomposable. The system S is 
the lowest dimensional one among non-commutative indecomposable 
systems. 

Example 4. Let H = and {01,02,03} be a linearly independent 
subset of H. Put Ei = Coi, E2 = Ca2 and E^ = Ca^. Then S = 
{H; El, E2, E3) is decomposable. In fact, let Hi = Ei y E2 ^ and 
H2 = Es^ 0. Then Hi + H2 = H, HiH H2 = and Ei = EinHi + 
Ei n H2, for i = l,2, 3. 



Example 5. Let H = and {&i, 62, ^3, ^4} be a subset of H. Put 
Ei = Cbi for i = 1, . . . , 4. Consider a system S = {H; Ei, E2, E^, E4) 
of four subspaces. Then the following are equivalent: 

(1) S is indecomposable. 

(2) Any three vectors of {61, 62, 63, 64} is linearly independent. 

(3) The set {61, 62, ^3} is linearly independent and 64 — A161+A262 + 
A363 for some scalars Aj 7^ (i = 1, 2, 3). 

Assume that M2, M3, ^4} C H and {f 1, f2, ^3, ^4} C H satisfy the 
above condition (2). Then S — {H;Cui,Cu2,Cus,Cu4) and T = 
{H; Cvi, Cv2, Cvs, CV4) are isomorphic. 

Example 6. Let H ^C^. Put = C ® C 0, E2 = C(l, 1, 1) and 
E3 = C(l,2,3). Then a system <S = {H; Ei, E2, E^) is decomposable. 

In fact, let E[ = {E2 V ^3) n Ei and Hi = E^n {E[)^ ^ 0. Let H2 = 
E2VE3 7^ 0. Then H1+H2 = H, Hif\H2 = and E^ = Eif^Hi+Eif\H2 
for i = 1,2,3. 

Example 7. Let H = C^. Put ^1 = C © C © 0, E2 = C(0, 0, 1), ^3 = 
C(0, 1, 1) and E4 = C(l, 0, 1). Then a system ^7 = {H; Ei, E2, E3, E^) 
of four subspaces is indecomposable. 

Example 8. Let H = C^. Put ^1 = C © C © 0, E2 = C(0,0, 1), 
E3 = C(l, 0, 0) + C(0, 1, 1) and E^ = C(l, 0, 1). Then a system Ss = 
{H; El, E2, E3, E4) of four subspaces is indecomposable. 

Example 9. Let H = C^. Put = C © C © 0, E2 = C(0, 0, 1), 
E3 = C(l, 0, 0) + C(0, 1, 1) and E4 = C(l, 0, 1) + C(0, 1, 0). Then a 
system Sg — {H; Ei, E2, E^, E4) of four subspaces is indecomposable. 

Example 10. Let H = C^. Put Ei = C(1,0,0) + C(0, 1,0), E2 = 
C(0, 1, 0) + C(0, 0, 1) E3 = C(l, 0, 0) + C(0, 1, 1) and E4 = C(0, 0, 1) + 
C(l, 1, 0). Then a system »Sio = {H; Ei, E2, Es, E4) of four subspaces 
is indecomposable. 

Remcirk Any two of the above indecomposable systems Sr,. . . , Sio of 
four subspaces are not isomorphic each other. 

Example 11. Let K ^ e'^{N) and H ^ K ®K. Consider a unilateral 
shift S : K ^ K. hei El ^ K ® E2 ^ Q ® K, E^ ^ {{x, Sx) e 
H\x E K} and £"4 = {{x^x) E H\x E K}. Then a system Su = 
{H; El, E2, E^, E4) of four subspaces in H is indecomposable. In fact, 
let R be an idempotent which commutes with S. Then i? is a lower 
triangular Toeplitz matrix. Since R is an idempotent, R — or R — I. 

Recall that Halmos initiated the study of transitive lattices. A com- 
plete lattice of closed subspaces of a Hilbert space H containing and 
H is called transitive if every bounded operator on H leaving each 
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subspace invariant is a scalar multiple of the identity. Halmos gave 
an example of transitive lattice consisting of seven subspaces in |Ha2j . 
Harison-Radjavi- Rosenthal |HRRj constructed a transitive lattice con- 
sisting of six subspaces using the graph of an unbounded operator. 
Any finite transitive lattice which consists of n subspaces gives an in- 
decomposable system of n-2 subspaces but the converse is not true. 
Following the study of transitive lattices, we shall introduce the notion 
of transitive system. 

Definition. Let S = {H; Ei, . . . , En) be a system of n subspaces in a 
Hilbert space H. Then we say that S is transitive if End{S) = CIh- 
Recall that S is indecomposable if and only if Idem{S) = {0, /}. Hence 
if S is transitive, then S is indecomposable. But the converse is not 
true. In fact the system Su as above is indecomposable but is not 
transitve, because End{S) contains S ® S. 

Example 12.(Harrison-Radjavi-Rosenthal |HHHj ) Let K = f(Z) and 
H = K ® K. Consider a sequence given by a„ = 1 for n < 

and a„ = ea;p((— l)"n!) for n > 1. Consider a bilateral weighted shift 
S : Vx K such that T(x„)„ = with the domain Vt = 

{{xn)n e £2(Z); J2n l«nX„P < oo}. Let E^ = K (B 0, E2 = (B K, 
E3 = {(x, Tx) E H;x E Vt} and E4 = {{x,x) E H;x E K}. Harrison, 
Radjavi and Rosental showed that {0, H, Ei, E2, E^, E4} is a transitive 
lattice. Hence the system S = {H; Ei,E2,E3, E4) of four subspaces in 
H is transitive and in particular indecomposable. 

Let S = [H] El, . . . , En) be a system of n subspaces in a finite- 
dimensional vector space H. Gelfand and Ponomarev |GPj introduced 
the conjugate system S* = {H*; E[, . . . , E'J, where = {f E H*; f{x) = 
for all X E Ei}. In our setting of Hilbert spaces, their conjugate sys- 
tem S* could be replaced by the following orthogonal complement. 

Definition. Let S = {H; Ei, . . . , En) be a system of n subspaces in a 
Hilbert space H. Then the orthogonal complement of S, denoted by 
S^, is defined by = {H; E^, ...,E^). Let T = {K; Fi, . . . , F„) be 
another system of n subspaces in a Hilbert space K and ip : S ^ T 
be a homomorphism. We define a homomorphism ip* : S-^ by 

p* : K ^ H. In fact, C E^, because <p{Ei) C F^. 

We denote by Sys^ the category of the systems of n subspaces in 
Hilbert spaces and homomorphisms. Then we can introduce a con- 
travariant functor : Sys'^ —>■ Sys^ by 

$^(5) = and $^(^) = p*. 

Proposition 3.7. Let H he a Hilbert space and S = (H; Ei, . . . , En) 

a system of n subspaces in H. Then S is indecomposable if and only if 
iS"*" is indecomposable. 
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Proof. If S is decomposable, then there exists an idempotent R E 
End{S) with i? 7^ and R 7^ Ih- Since R{Ei) C -Ej, we have 
R*{El) C E,^. Thus i?* G End{S^) is an idempotent with i?* ^ 
and -R* 7^ Ih, that is, iS"*- is decomposable. This implies the desired 



Similarly we have a same fact for transitive systems. 

Proposition 3.8. Let H be a Hilbert space and S = {H; Ei, . . . , En) 

a system of n subspaces in H. Then S is transitive if and only if S-^ 
is transitive . 



It is easy to see the case of indecomposable systems of one subspace 
even in an infinite-dimensional Hilbert space. 

Proposition 4.1. Let H be a Hilbert space and S = {H]E) a system 
of one subspace. Then S = {H; E) is indecomposable if and only if 
(C;0) orS^ (C;C). 

Proof If E and E H, then S = {E; E) © {E^- 0) gives a non- 
trivial decomposition. Assume that S is indecomposable. Then E = {) 
or E = H. Suppose we had diniH > 2, then there exist non-zero 
closed subspaces Hi and H2 such that H = Hi + H2 and HiH H2 = 0. 
This gives a non-trivial decompositon of S. The contradiction shows 
that dimH = 1. Hence S = (C; 0) or S = (C;C). The converse is 
trivial. □ 

Let S = (if; E) and S' = {H'; E') be two systems of one subspace. 
Then S and S' are isomorphic if and only if dimii^ = dimii^' and 
codimii^ = codimi?'. 

5. INDECOMPOSABLE SYSTEMS OF TWO SUBSPACES 

It is a well known fact that the relative position of two subspaces 
El and E2 in a Hilbert space H can be described completely up to 
unitary equivalence as in Araki jAr|, Dixmier jDj and Halmos |Halj . 
The Hilbert space H is the direct sum of five subspaces: 

H={Ein E2) © (the rest) © {Ei n E^) © {E^ n E2) © (^1^ n E^). 

In the rest part, Ei and E2 are in generic position and the relative 
position is described only by "the angles" between them. In fact the 
rest part is written as i^' © for some subspace K and there exist two 
positive operators c, s G B{K) with null kernels with + = 1 such 



conclusion. 



□ 



4. INDECOMPOSABLE SYSTEMS OF ONE SUBSPACE 



that 
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and 

E2 = {El n E2) © Im ^ © © {E^ n E2) © 0. 

By the functional calculus, there exists a unique positive operator 9, 
called the angle operator, such that c = cos 6* and s = sin 9 with 
< < f. 

Proposition 5.1. Let S = {H; Ei, E2) be a system of two subspaces 
in a Hubert space H . Then S is indecomposable if and only if S is 
isomorphic to one of the following four commutative systems: 

5i = (C;C,0), ^2 = (C;0,C),53= (C;C,C), = {C;0,0). 



Proof. Let G B{H) be the projection of H onto i = 1,2 with 
the canonical decomposition as above. Suppose that dimi^ > 2. Then 
there exists a projection p G B{K) with Q ^ p ^ Ik satisfying p 
commutes with c and s. Let Hi := Im(p © p) C K ® K and H2 := 
H^ n H. Let pi G B{H) be the projection of if onto Hi. Since non- 
trivial projection pi commute with ei and 62, 5 is decomposable by 
Lemma|n21 Therefore if S is indecomposable, then dim K <1 and only 
one of the five direct summands is non-zero. If the rest component were 
non-zero, then it is isomorphic to a decomposable one as in Example 
2. Thus the rest component does not appear. One of the other part 
is commutative. Since S is indecomposable, S is one of 5i, . . . , ^4 by 
Proposition 13.61 The converse is clear. □ 

6. SOME PROPERTIES OF INDECOMPOSABLE SYSTEMS OF 

n-SUBSPACES 

Let S = {H; Ei, . . . , En) be a system of n subspaces in a Hilbert 
space. We denote by V^^^Ei the closed subspace spanned by £'1, ... , En. 
If S is indecomposable and dim if > 2, then it is easy to see that 

n n 

Pi = and y Ei = H. 

i=l i=l 

In fact, on the contrary suppose that M := H'^^iEi 7^ 0. We choose a 
one-dimensional subspace F C M. Since dim if > 2, the orthogonal 
decomposition H = F (B F-^ of the Hilbert space H gives a non-trivial 
decomposition of the system S. This contradicts to that S is indecom- 
posable. Hence we have (l^^iEi = 0. Since the orthogonal complement 
is also indecomposable, we have V^^^i^j = (H'^^iE^)-^ = H. But we 
can say more as follows: 

Proposition 6.1. Let S = {H; Ei, . . . , En) be a system of n subspaces 
in a Hilbert space. If S is indecomposable and dim ii" > 2, then for any 
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distinct n-1 subspaces E^^, . . . , £'i„_i, we have that 

n—l n—1 

f]Ei^ = and V Ei^ = H. 

k=l k=l 

Proof. We may and do assume that E^^ — Ei^E^^ — E2, . . . , Ei^_^ — 
En-i- On the contrary suppose that M := n"r/i?i 7^ 0. Since dimi? > 
2, we can choose a one- dimensional subspace F C M. Consider two 
subspaces F and E^ in H. We have the following canonical decompo- 
sition into five parts: 

F = (FnK)eim^J Q ^ ©(Fn£;^)©o©o, 

We denote hy K (B K the underlying subspace of the part in generic 
position. 

(i) (the case that X = 0): Since F n E^ = fi^^i^'i = 0, we have 
F = F (1 E;^, so that F C E^. Let Cj and / be the projections of 
H onto Ei and F respectively. Then / commutes with each Cj. There- 
fore the orthogonal decomposition H = F(B F-^ of H gives a non-trivial 
decomposition of the system S. This contradicts to that S is indecom- 
posable. Hence M = (l^'^Ei = 0. 

(ii) (the case that K ^ 0): Since F is one-dimensional, 

© + Im ( ^2 1 = © 



and 

(x©o)nim( - ) =0. 



2 

c cs 



Then there exists an invertible operator T G © i^T) such that 

r(is:©0) = i^©0, andT(Im^^] Jf^j^O©/^. 

We define an invertible operator y9:=/©T©7©7©/e B{H). Let 
E^ := ip{Ei) for i = 1, . . . , n. Since 5 is indecomposabe, a new system 
5' := {H; E[,..., E'J is indecomposable. Since F = ^{F), F C n^'^El 
and F is orthogonal to E'^. Let e[ and / be the projections of H onto 
Fj' and F. Then / commutes with each e^. Therefore the orthogonal 
decomposition H = F ® F-^ of H gives a non-trivial decomposition of 
the system S' . This contradicts to that S' is indecomposable. Hence 
M = n^r/Fi = 

Since the orthogonal complement S-^ is also indecomposable, we also 
have ylZ\Ei^ ^H. □ 
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Corollary 6.2. Let S = {H; Ei, . . . , En) a system of n suhspaces in 
a Hilbert space. If S is indecomposable and H is infinite-dimensional, 
then Ei is finite dimensional } <n — 2. 

Proof. On the contrary, suppose that there were distinct n-1 finite- 
dimensional subspaces Ei^ , • • • , Eir,-i ■ Then H = Vfc=i ^^^o finite- 
dimensional. This is a contradiction. □ 

7. INDECOMPOSABLE SYSTEMS OF THREE SUBSPACES 

Gelfand and Ponomarev ( ICilPj ) claimed that there exist only nine, 
finite-dimensional, indecomposable systems of three subspaces. We 
shall include a direct proof of it. We do not know whether there exists 
an infinite-dimensional transitive systems of three subspaces. In fact it 
is still an unsolved problem whether there exists a transitive lattice con- 
sisting of five elements in an infinite-dimensional Hilbert space. There- 
fore it is worth while investigating the existence of infinite-dimensional 
indecomposable systems of three subspaces. 

Proposition 7.1. Let S = {H; Ei, E2, E^) be an indecomposable sys- 
tem of three subspaces. If H is infinite dimensional, then Ei ^ and 
Ei^H for I = 1,2,3. 

Proof. On the contrary suppose that Ei = 0. Then S' = {H; E2, E^) 
is an indecomposable system of two subspaces. Hence by Proposition 
15. H H is finite dimensional. This is a contradiction. Hence Ei ^ 0. 
Similary Ei ^ and Ei ^ H foi i = 1, 2, 3. □ 

Theorem 7.2. Let S = {H; Ei, E2, E3) be an indecomposable system 
of three subspaces in a Hilbert space H. Then the following hold. 
(l)If H is infinite- dimensional, then for any i 7^ j, Ei (1 Ej = and 
Ei + Ej is a non-closed dense subspace of H. In particular each Ei is 
infinite-dimensional. 

(2} \GP\ If H is finite- dimensional, then S is isomorphic to one of the 
following eight commutaitve systems Si, . . . ,Ss and one non- commutative 
system Sg: 

5i = (C; 0,0,0), 52 = (C;C,0,0), ^3 = (C; 0, C, 0), 
54 = (C;0,0,C), ^5 = (C;C,C,0), = (C; C, 0, C), 
57 = (C;0,C,C), 58 = (C;C,C,C), = (C^; C(l, 0), C(0, 1), C(l, 1)). 

Proof. If dimH = 1, then S is commutative. Hence if S is isomorphic 
to one of Si,...,Ss. Therefore we may assume that S is indecom- 
posable and dim if > 2. Then, by Proposition 16. for any i 7^ j, 
Ei n Ej = and Ei + Ej is a dense subspace of H. We claim that if 
El + E2 = H, then H is finite-dimensional and S is isomorphic to (Sg. 
It is enough to show the claim to prove the theorem. In fact, assume 
that the claim holds. (l)If H is infinite-dimensional, then Ei + E2 is 
not closed. Similarly for any i ^ j , Ei + Ej is not closed. (2) If H is 
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finite-dimensional, then Ei + E2 = H . Thus S is isomorphic to 1S9. We 
shall show the claim. Since E1DE2 = Q and Ei + E2 = H, there exists 
T G B{H)-^ such that T{Ei) = Ei and T{E2) = E^. Therefore we 
may assume that E2 = E^ to show the claim. Considering the canoni- 
cal decomposition for two subspaces Ei and E^, we have the following 
descripton of three subspaces: 



where the underlying Hilbert space H is decomposed into five parts 



H={Ein E3) (BiK(BK)(B (^1 n ^3^) © {E^ n E3) © {E^ n ^3^). 



If two parts of the above five parts were non-zero, then S can be de- 
composed non-trivially. This contradicts to that S is indecompos- 
able. Hence only one of the above five parts is non-zero. If the 
part K (B K = 0, then S is commutative. Since S is indecompos- 
able, dim if = 1. This contradicts to that dim if > 2. Hence the 
only the part K (B K ^ 0. If dimi^' = 1, then it is clear that S 
is isomorphic to Sg. If dimi^' > 2, then there exists a projection 
p G B{K) with p Ik satisfying p commute with c and s. 
Let Hi := lm{p Q) p) C K ® K = H and H2 := n H. Let 
Pi, 61,62, 63 G B{H) be the projections of H onto Hi, Ei, E2, Es re- 
spectively. Since non-trivial projection pi commute with ci, 62 and 63, 
S is decomposable by Lemma \'A.2l This is a contradiciton. Hence the 
case that dimi^ > 2 does not occur. We have shown the claim. □ 



We can associate a system of four subspaces for any operator. 
Definition, (bounded operator system) We say that a system S = 
{H; El, E2, E3, E4) of four subspaces is a bounded operator system if 
there exist a Hilbert space Ki, K2 and bounded operators T : Ki ^ K2, 
S : K2—^ Ki such that H = Ki® K2 and 



We denote by St,s the above operator system S. We often identify Ei 
with Ki and E2 with K2. In particular we associate an operator system 
St '■= St,i = {H; Ei, E2, E^, E4) for any single operator T G B{K) such 
that H = K ® K and 



Ei = K®Q,E2 = Q®K,E^ = {{x,Tx)-xe K}, Ei = {{y,y)-ye K}. 





8. OPERATOR SYSTEMS 



Ei = Ki®Q, ^2 = © K2, 

Es = {(x,Tx);x G Ki}, E^ = {{Sy,y)-ye K2}. 
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We shall study a relation between the system St of four subspaces 
and a single operator T. 

Proposition 8.1. Let St,s = {H; Ei, E2, E3, E4) be a bounded operator 
system associated with T : Ki ^ K2 and S : K2 —>■ Ki. Then 

End{ST,s) = {Ai © G B{Hy, Ai e B{Ki), A2 G B{K2), 
AiS = SA2, A2T = TAi},and 

Idem{ST,s) = {Ai Q) A2 e B{H); Ai e B{K,), A2 G B{K2), 
AiS = SA2, A2T = TAu Al = Au Al = A2} 

Proof. Let A G End{S). Since A{Ei) C Ei and A{E2) C E2, we have 
A = ^10^2 for some Ai G B{Ki), A2 G B{K2). Since ^(^3) C ^3, for 
any x G Ki, {Ai © A2){x,Tx) G E3. Thus (Aix, AaTx) = {y,Ty) for 
some y G K2. Therefore A2TX = TAix. Thus A2T = TAi. Similarly 
A^E^) C -Es implies ^15" = SA2. The converse is clear. We get the 
equality for Idem{S) immediately. □ 

Corollary 8.2. Let St = {H; Ei, E2, E3, E4) be a bounded operator 
system associated with a single operator T G B{K). Then 

EndiSr) = {B ® B e B{H)] B G B{K), BT = TB}, and 
IdemiSr) = [B ® B e B{H)] B G B{K), BT = TB, 5^ = B}. 

Definition. Recall that a bounded operator T on a Hilbert space K is 
called strongly irreducible if there do not exist two non-trivial subspaces 
M gK andN gK such that T(M) C M, T{N) C N, MnN = and 
M + N = K. We also see that T is strongly irreducible if and only if 
there does not exist any non-trivial idempotent P such that PT = TP. 
See a monograph |JWj by Jiang and Wang. 

Corollary 8.3. Let St = {H; Ei, E2, E^, E4) be a bounded operator 
system associated with a single operator T G B{K). Then St is inde- 
composable if and only ifT is strongly irreducible. 

Example. Let K = and 5* G B{K) be the unilateral shift. Let 

P G B{K) be an idempotent which commutes with S. Then P is a 
lower triangular Toeplitz matrix. Since P is an idempotent, we have 
P = or P = / as in Lemma flO.ll Thus S is strongly irreducible, as 
already known, for example, in [JWj, and Ss is indecomposable. 

Corollary 8.4. Let St = {H; Ei, E2, E^, E4) be a bounded operator 
system associated with a single operator T G B{K). If St is decompos- 
able, then T has a non-trivial invariant subspace. 
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Proof. Let St be decomposable, 
potent P such that PT = TP. 
subspace. 



Then there exists a non-trivial idem- 
Then ImP is a non-trivial invariant 

□ 



Proposition 8.5. Let St = {H; Ei, E2, E^, E^) and St' = {H'; E[, E'^, 
E'^,E'^) be bounded operator systems associated with operators T e 
B{K) and T' e B{K'). Then St and St' are isomorphic if and only if 
T and T' are similar. 

Proof. Assume that St and St' are isomorphic. Then there exists a 
bounded invertible operator A : H ^ H' with A{Ei) = E[ for i = 
1,2,3,4. Since A{Ei) = E[ for i = 1,2,4, we have A = B ® B hr 
some invertible operator B : K ^ K'. And ^(£"3) C E^ implies that 
BT — T'B, that is, T and T' are similar. The converse is clear. □ 

Remcirk. The above proposition shows that the classification of sys- 
tems of four subspaces contains the classification of operators up to 
similarity in a certain sense. 

Example, (an uncountable family of indecomposable systems of four 
subspaces) Let K = and H = K ® K. Consider a unilateral 

shift S : K ^ K. For a parameter a G C, let -Ei = © 0, E2 = 
0®K,E3 = {{x, {S+aI)x)\x e K} and £4 = {{x,x)\x e K}. Then the 
system Sa = {H; Ei,E2,E2, E4) of four subspaces are indecomposable. 
li a (3, then Sa and Sp are not isomorphic, because the spectra 
a{S + a) a{S + P) and S + al and S + pi are not similar. Thus we 
can easily construct an uncountable family {Sa)aec indecomposable 
systems of four subspaces. 

As the single operator case, we also obtain the following: 

Proposition 8.6. Let St,s = (B; Ei, E2, E^, E4) and St',s' = {H'\ E[, 
E2,E'^,E'^) be bounded operator systems associated with operators S G 
B{K2,Ki),T G B{Ki,K2), S' G B{K!^,K[),T' G B{K[,K!^) . Then 
St,s and St',s' clt^^ isomorphic if and only if there exist bounded invert- 
ible operators Ai : Ki ^ K[ and A2 : K2 ^ K2 such that AiS — S' A2 
and A2T = T'Ai. 

Proposition 8.7. Let St,s = {H; Ei, E2, E^, E4) be a bounded operator 
system associated with operators S G B{K2, Ki),T G B{Ki, K2).@Then 
the orthogonal complement of the system St,s is isomorphic to another 
bounded operator system up to a permutation of subspaces and given by 

where aij is a transposition of i and j. 

Proof. It is evident from the fact {{x,Tx) G Ki® K2]x G Ki}^ = 
y) G e K2] y G K2} and etc. □ 

Proposition 8.8. Let St,s = {H; Ei, E2, E^, E4) be a bounded operator 
system associated with operators S G B{K2, Ki),T G B{Ki, K2). IfT 
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is invertible, then St,s is isomorphic to Sj^ts- U ^ invertible, then 
St,s is isomorphic to Sst,i- 

Proof. Let T be invertible. Define an invertible operator if : Ki (B 
K2 ^ K2® K2 by if{x,y) = {Tx,y). Then ^{E,) = ^{Ki © 0) = 
K2 © 0. ^(^2) = (^(0 © fsTa) = © K2. Since (/?(x,Tx) = {Tx,Tx), 
ip{Es) = v9(grapliT) = {{y,y);y G K2}. Because ip{Sy,y) = {TSy.y), 
ipiyE^) = (y9(cograph S*) = {{TSy,y);y G K2} = cograph TS'. Hence 
St,s is isomorphic to Sj^ts- If S is invertible, use an invertible operator 
ijj : Ki ® K2 Ki ® Ki defined by ipix, y) = (x, Sy). □ 

Bounded operator systems can be extended to (unbounded) closed 
operator systems. 

Definition. (closed operator systems) We say that a system S = {H; Ei, 
E2,E3,Ei) of four subspaces is a closed operator system if there exist 
Hilbert spaces Ki,K2 and closed operators T : Ki D D{T) — > K2, 
S : K2D D{S) Ki such that H = Ki ® K2 and E^ = Ki ® 0, 

= © K2, ^3 = {{x, Tx)-xe D{T)}, E, = {{Sy, y);ye D{S)}. 

We also denote by St,s the above operator system S. 

We shall give a characterization of (densely defined) closed operator 
systems. 

Proposition 8.9. Let S = [H; Ei, E2, E^, E4) be a system of four 
subspaces in a Hilbert space H . Then the following are equivalent: 

(1) S is isomorphic to a closed operator system St,s for some closed 
operators T : Ei D D{T) E2 and S : E2 D 'd{S) ^ Ei. 

(2) E1 + E2 = H andE.nEj = Ofor{i,j) = (1,2), (2,3) and (4, 1). 

Moreover if these conditions are satisfied, then D{T) := E'l fl {E-^ + E2) 
andD{S) := E2 n {E^ + Ei) . 

Proof. (1)^(2): It is trivial. (2)^(1): By Lemma [2. 11 we may assume 
that E2 = E^. Put Ki = El and K2 = E2. Then H = Ei®E2. Since 
E^n E2 = 0, for any Xi E EiH {E3 + E2), there exist unique 0:3 G E3 
and X2 G E2 such that Xi = X3 — X2- Define a linear operator T : Ei D 
D(T) E2 by Txi = X2 with a domain D{T) := Ein{E3 + E2). Since 
El + E2 = H, for any X3 G -E3 there exist Xi G Ei and X2 G E2 with 
X3 = Xi + X2- This implies that graph T = £^3. Hence T is a closed 
operator. Similarly there exists a closed operator S : E2 D D{S) Ei 
with & domain D{S) := E2n{E^ + El). □ 

Corollary 8.10. Let S = {H; Ei, E2, E^, E^) be a system of four sub- 
spaces in a Hilbert space H. Then the following are equivalent: 

(1) S is isomorphic to a closed operator system St,s for some densely 
defined closed operators T : Ei D D{T) — * E2 and S : E2 D 
D{S)^Ei. 

(2) Ei + E2 = H andEinEj = for = (1, 2), (2, 3), (4, 1), 
El n (i?3 + E2) is dense in -Ei , i?2 H {E^ + Ei) is dense in E2 
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We immediately have a characterization of bounded operator sys- 
tems. 



Corollary 8.11. Let S = [H; Ei, E2, E^, E4) be a system of four sub- 
spaces in a Hubert space H . Then the following are equivalent: 

(1) S is isomorphic to a bounded operator system. 

(2) Ei + Ej = H and Ei n = for {i,j) = (1, 2), (2, 3) and (4, 1) 

Proof (1)^(2): It is trivial. (2)^(1): Since E3 + E2 = H, we have 
D{T) = El n {E3 + E2) = El. Because graph T = E3 is closed , T is 
bounded by the closed graph theorem. Similarly E4 + Ei = H implies 
that D{S) = E2 and S is bounded. □ 

Corollary 8.12. Let S = [H; Ei, E2, E^, E4) be a system of four sub- 
spaces in a Hubert space H . Then the following are equivalent: 

(1) S is isomorphic to a bounded operator system associated with a 
single operator. 

(2) Ei + Ej = H andEiHEj = for{i,j) = (1, 2), (2, 3), (4, 1) and 
(2,4). 

Proof. (1)^(2): It is trivial. (2)^(1): By the preceding Corollary, S 
is isomorphic to a bounded operator system St,s- Since £'2 fl -E4 = 0, 
S is one to one. Since E2 -\- E4 = H , S is onto. Therefore St,s is 
isomorphic to a bounded operator system Sstj = <Sst associated with 
a single operator ST by Proposition 18.81 □ 

Proposition 8.13. Let St = {H; Ei, E2, E^, E4) be a bounded opera- 
tor system associated with a single operator T G B{K). Then St is 
transitive if and only if dim K = 1. If it is so, then St is isomorphic 
to 

(C^; C © 0, © C, {(x, Ax); a; G C}, {{x,x);xe C}) 
for some A G C. 

Proof. Recall that St is transitive if 

End{ST) = {B®B e B{H)] B G B{K), BT = TB} = CL 

Hence St is transitive if and only if {T}' := {B G B{K); BT = TB} = 
CI if and only if dimi^ = 1. 

□ 

But certain unbounded operators on an infnite dimensional Hilbert 
space give transitive systems of four subspaces. 

Example (Harrison-Radjavi- Rosenthal IHRRJ) Let K = £^(Z) and 
H = K ® K . Let (an)nGZ be a sequence given by a„ = 1 for n < and 
a„ = exp{{—l)'^n\) for n > 1. Define a bilateral weighted shift T : K D 
D{T) K hy (Tx)n = a„_ix„_i with the domain D(T) = {(x„)„ G 
^^(^);En Kxnl'^ < 00}. Let El = K®0, E2 = 0(BK, E3 = {ix,Tx) G 
K ® K]x G -D(T)}, and E^ = {(x,x) G K ® K;x G K}. Harrison, 
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Radjavi and Rosenthal showed that {H, Ei, E2, E^, E4, 0} is a transitive 
lattice in [HRRj. Hence S = {H; Ei, E2, E^, E4) is a transitive system 
of four subspaces. 

We can extend their example to construct uncountably many tran- 
sitive systems. 

Lemma 8.14. Let St = {H; Ei, E2, E3, E^) and St' = {H'; E[, E'^, E'^, 
E'^) be closed operator systems associated with operators T : D(T) — >• 
K, T' : D{T') — > K' . Then St and St' are isomorphic if and only if 
T and T' are similar. 

Proof. The proof is as same as bounded operators if we see the domains 
of the closed operators carefully. □ 

Example. Let K = ^^(Z) and H = K ® K. For a fixed number 
a > 1, let {wn)n& = ('U^n(a))nez be a sequence given hj Wn = 1 for 
n < and w„ = exp((— a;)")for {n > 1). Define a bilateral weighted 
shift Ta : K D —^Khj {Tax)n = w„_iX„_i with the domain 
Da = {{xn)n e ^„ \wnXn\^ < oo}. Let = K © 0, ^2 = © K, 

E^ = {{x, T^x) e K ® K;x e Da, and E4 = {{x,x) e K ® K;x e K}. 



Proposition 8.15. If a > 1, then the above system Sa = {H; Ei, E2, E^, 

E4) is a transitive system. Furthermore if a (3, then Sa and Sf^ are 
not isomorphic. 

Proof Let V G Hom{Sa,Sp). Since V{Ei) C Ei for i = l,2,A, V = 
AQ) A for some A = {aij)ij e B{K). Since V{E^) C E^ and e„ G Da, 

(A © y4)(e„, TqC^) = [ACn, ATaCn) G E^ . 

Hence ATaCn = TpAcn- Comparing (m + l)-th component, we have 
w„(a)a^+i_„+i = Wm{,l3)ayn^n, that is, 

_ w,n{l3) 
Wn{a) 

Therefore for any G N, 

_ WmjP) ■ ..Wm+k-l{P) _ , , 

Wn[a) . ..Wn+k-l[Ct) 

where 



cfc(m, n) = ii-f3r + ■■■ + i-pr"-'-') - ii-ar + ■■■ + i-ar^'-') 

1 + (3 1 + a 

(i)(the case when a = j3): Putting n = m, we have Ck{m,m) = 0. 
Hence the diagonal of A is constant. If A were not a multiple of the 
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identitiy, then there exist distinct m and n with a^.n 7^ 0. According 
to m < n or m > n, for a sufficient large k, 



5 

m+k—l 1 I / \n+k—l\ 



Ck[m, n) = {{-ar + ■■■ + (-«)") - + ... + (_« 

or 

Cfc(m, n) = -((-a)" + ■ ■ ■ + (-a)") + ((-«)"+^-^ + ■ ■ ■ + 

In either case we have hmsup;, Cjt(m, ra) = 00. Hence am+k,n+k is not 
bounded as /c — > cx). This contradicts to that A is bounded. Therefore 
yl is a scalar. We have shown that Sa is a transitive system. 
(ii)the case when a ^ (3: We may and do assume that 1 < a < (3. \{ A 
were not equal to 0, then there exist m and n with am,n 7^ 0. Since 

we have limsup^ Cfc(m, = cxd. This contradicts to that A is bounded. 
Therefore A = 0. We have shown that Hom^SaiSf^) = 0. Therefore 
Sa and are not isomorphic. □ 

Proposition 8.16. Let St.s = {H; Ei, E2, E^, E4) be a bounded oper- 
ator system associated with operators S G B{K2, Ki),T G B{Ki, K2) ■ 
Then S is transitive if and only if S is isomorphic to (C;C,0, C, 0), 
(C;0,C,0,C), (C2;C©0,0©C,{(a;,a;);x G C},0©C) or (C2;C©0,0© 
C, {{x, \x); X G C}, {{x,x);x G C}) for some A G C. 

Proof. Suppose that S = St.s is transitive. If dimH = 1, then S is 
isomorphic to (C; C, 0, C, 0) or (C; 0, C, 0, C). We assume that dimH > 
2. Since ST © TS G End{ST,s) and S is transitive, there exists A G C 
such that ST = XI Ki and TS = XI k2- 

In the case that A 7^ 0, T and S are invertible and S = XT^^. By 
Proposition 18. 8^ St,s is isomorphic to 5a/^,^ Jj^^ . Applying Proposition 
I8.13| S is isomorphic to 

(C^; C © 0, © C, {(a;, Ax); x G C}, {{x,x);xe C}) 

for some A G C. 

In the case that A = 0, we have ST = and TS = 0. Since SS* © 
S*S,T*T © TT* G EndiSr.s) and S is transitive, we have SS* = 
alK„S*S = alK2,T*T = (3Ik, and TT* = ^Ik^- Because ST = 0, 
a/3 = 0. Hence a = or /3 = 0, so that 5* = or T = 0. If T = 
0, then a subsystem {II;Ki © 0,0 © K2, {{Sy,y);y G K2}) of three 
subspaces is transitive. Since dim if > 2, the subsystem is isomorphic 
to (C2;C©0,0©C, G C}). Hence 5 is isomorphic to (C2;C© 

0, 0©C, C©0, {{x,x);x G C}) . Similarly if 5 = 0, then S is isomorphic 
to (C^; C © 0, © C, {(x, x); X G C}, © C). The converse is clear. □ 
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9. CLASSIFICATION THEOREM BY GeLFAND-PONOMAREV 



One of the main problem to attack is a classification of indecompos- 
able systems S = {H; Ei, E2, E^, E^) of four subspaces in a Hilbert 
space H. In the case when H is finite-dimensional, Gelfand and Pono- 
marev completely classified indecomposable systems and gave a com- 
plete list of them in [(ilPj . The important numerical invariants are 
dim H and the defect defined by 

4 

p{S) := dim Ei — 2dim H. 
1=1 

Theorem 9.1 ( Gelfand- Ponomarev [(tPI ). The set of possible values 
of the defect p{S) for indecomposable systems S of four subspaces in a 
finite- dimensional space is exactly the set {—2, —1, 0, 1, 2}. 

The defect characterizes an essential feature of the system. If p{S) = 
0, then S is isomorphic to a bounded operator system up to permuta- 
tion of subspaces , that is, there exists a permutation a on {1,2,3,4} 
and a pair of linear operators A : E ^ F and B : F ^ E such that 
H = E®F, = E®0, E„i2) = 0©F, E^o) = {{x, Ax) eH-xeE} 
and £^4 = {{By,y) E H]y E F}. If p{S) = ±1, S is represented up 
to permutation hy H = E ® F, Ei = E ® 0, E2 = ® F, E3 and E4 
are subspaces of H that do not reduced to the graphs of the operators 
as in the case that p{S) = 0. A system with p{S) = ±2 cannot be 
described in the above forms. 

Following |GPj , we recall the canonical forms of indecomposable sys- 
tems S = {H; El, E2, E3, E4) of four subspaces in a finite-dimensional 
space H up to permutation in the following: (A) the case when dim H = 
2k for some positive integer k. 

There exist no indecomposable systems S with p{S) = ±2. Let H 
be a space with a basis {ei, . . . , e^, /i, . . . , fk}- 
{l)Ss{2k, -1) = {H; El, E2, E^, E^) with p{S) = -1 

H = [ci, . . . , Cfc, /i, . . . , fk], 
El = [ci, . . . , Cfc], E2 = [fi, ■ ■ ■, fk], 
Es = [{e2 + fi),...,{ek + fk-i)], 
^4 = [(ei + /i),...,(efc + /fe)]. 

{2)S3{2k, 1) = (H; El, E2, E3, E,) with p{S) = 1 

H = [ci, . . . , Cfc, /i, . . . , fk]. 

El = [ci, . . . , Cfc], E2 = [fi, . . . , fk], 

E3 = [ei, (62 + /l), . . . , (Cfc + fk-l), fk], 

Ei=[{ei + fi),...,{ek + fk)]. 
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{3)Si42k, 0) - {H; E,, E^, E^, E^) with p{S) = 
H = [d, . . . , efe, /i, . . . , fk], 
El = [ei,...,efc], E2 = [/i,...,/fe], 

E3 = [ei, (62 + /l), . . . , (Cfc + /fc_i)], 

^4= [(ei + /i),...,(efc + /fe)]. 

(4)5(2fc, 0; A) = {H; Ei, E2, E3, E^) with p{S) - 

H = [ei, . . . , Cfc, /i, . . . , /fc], 

-El = [ei, . . . , Cfc], £"2 = [/i, . . . , fk]-, 

Ez = [(ei + A/i). (62 + /i + A/2), . . . , (efc + fk-i + A/^)], 

^4= I(ei + /i),...,(efc + /fc)]. 

Every other system Si{2k,p), Si,j{2k.O) can be obtained from the 
systems S3{2k,p), 5i,3(2/c,0) by a suitable permutation of the sub- 
spaces. Let (7jj be the transposition {i, j). We put Si{2k, p) = az^iSz{2k, p) 
for p = —1, 1. We also define Sij{2k,0) — ai^iasjSi^s{2k,0) for i,j e 
{1,2,3,4}. 

(B)the case dim H = 2k + 1 is odd for some integer A; > . Let H be 
a space with a basis {ci, . . . , e^, e^+i, /i, . . . , fk}- 
{5)Si{2k + 1, -1) = (H; El, E2, E^, E^) with p{S) = -1 

H — [ei, . . . , efe, Cfe+i, fi, - - - , fk], 

El — [ei, . . . , efc, efc+i], £'2 = [/i, . . . , /fc], 

E3 = [(e2 + /i),...,(efc+i + /jfc)], 

^4 = [(ei + /i),...,(efe + /fe)]. 

(6) 52(2A; + 1,1) = {H; Ei, E2, Es, E^) with p{S) = 1 

H = [d, . . . , efc, efe+i, /i, . . . , /fc], 
-E'l = [ei, . . . , Cfe, efe+i], E2 = [/i, . . . , /fe], 
-S3 = [ei, (62 + /i), . . . , (efe+i + fk)], 
-E4 = [(ei + /i), . . . , (efc + /fe), Cfe+i]. 

(7) 5i,3(2A; + 1, 0) = (//; £;2, £;3, Ei) with p(5) = 

H — [ei, . . . , efc, Cfe+i, /i, . . . , /fc], 

-E'l = [ei, ■ ■ ■ , efe, efe+i], E2 = [/i, . . . , /fe], 

-E3 = [ei, (62 + /i), . . . , (Cfe+i + fk)], 

^4 = [(ei + /i),...,(efe + /fe)]. 

(8) <S(2A; + 1, -2) = (//; £;2, E^, E^) with p(5) = -2 

if = [ei, . . . , efe, Cfe+i, /i, . . . , /fe], 

-E'l = [ei, . . . , efc], £'2 = [/i, . . . , /fc], 

^3 = [(e2 + /i),---,(efe+i + /fe)], 

Ea = [(ei + /2), . . . , (efc_i + /fc), (efc + e^+i)]. 
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{9)S{2k + 1, 2) = {H; El, E2, E3, E4) with p{S) = 2 

H = [ei, . . . , Cfc, Cfc+i, fi,. . . , fk], 

El = [ei, . . . , Cfc, Cfc+i], E2 = [fi, ■ ■ ■ , fk, Cfc+i], 

E3 = [ei, (es + /i), . . . , (cfc+i + fk)], 

Ei = [fi, (ei + /s), . . . , {ck-i + fk), (cfc + Cfc+i)]. 

We put 5i(2fc + 1,-1) = ai.iSi{2k + 1,-1), Si{2k + 1,+1) = 
a2,rS2{2k + 1,1), 5ij(2A; + 1,0) = ai^.a^jSi^si^k + 1,0) for i,j G 
{1,2,3,4}. 

Theorem 9.2 (Gelfand-Ponomarev |GPj ). // a system S of four sub- 
spaces in a finite- dimensional H is indecomposable, then S is isomor- 
phic to one of the following systems: 

Sij{m,0), < G {l,2,3,4},m = 1,2,...); S{2k,0;\), (A G 

C, A 7^ 0, A 7^ 1, = 1, 2, ...), 5,(m, -1), Siim, 1), (z G {1, 2, 3, 4}, m = 
1, 2, ...); 5(2fc + 1, -2), S{2k + 1, +2), {k = 0, 1, ...). 

Remark. It is known that if S is an indecomposable system of four sub- 
spaces in the above Theorem satisfying p{S) 7^ 0, then S is transitive, 
for example, see |B]. 

10. EXOTIC INDECOMPOSABLE SYSTEMS OF FOUR SUBSPACES 

In this section we shall construct uncountably many, exotic, inde- 
composable systems of four subspaces, that is, indecomposable sys- 
tems which are not isomorphic to any closed operator system under 
any permutaion of subspaces. 

Exotic examples. Let L = £^(N) with a standard basis {ei, 62, ■ ■ ■ }■ 
Put K = L®L and H = K®K = L®L®L®L. Consider a unilateral 
shift : L ^ L by Scn = Cn+i for n = 1, 2, . . . . For a fixed paramater 
7 G C with I7I > 1, we consider an operator 

T^={^1* eB{K) =B{L®L). 
Let Ei = K ®0, E2 = 0® K, 

Es = {(x,T^x) G K®K]xe fs:}+C(0, 0, 0, ei) = graph T^+C(0, 0, 0, Ci), 
and £"4 = {{x,x) G K Q) K;x G K}. Consider a system iS^ = 
{H; El, E2, E2,, E4). We shall show that S-y is indecomposable. If 
I7I > 1, then S-y is not isomorphic to any closed operator systems under 
any permutation. We could regard the system is a one-dimensional 
"deformation" of an operator system. First we start with an easy fact. 

Lemma 10.1. Assume that a bounded operator A G B{i'^{'N)) is rep- 
resented as an upper triangular matrix A = {aij)ij by a standard basis 
{ci, 62, . . .}■ If the diagonal is constant X, i.e., an = A for i = 1, . . . , 
and A is an idempotent, then A = or A = I. 
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Proof. Put N = A — XL Then N is an upper triangular matrix with 
zero diagonaL Comparing the diagonals for 

XI + N = A = = X"^! + 2XN + N^, 

we have = A. Hence A = or 1. If A = 0, then A^^ = jy, gj^ce 
is an idempotent and an upper triangular matrix with zero diagonal, 
N — 0, that is, ^4 = 0. If A = 1, then (/ — A) is an idempotent and an 
upper triangular matrix with zero diagonal, / — ^4 = 0, that is, A — I. 

□ 

Theorem 10.2. //I7I > 1, then the above system — {H; E-i, E2, E^, E4) 
is indecomposable. 

Proof. Wc shall show that {V G End{S^,.);V^ = V} ^ {0,1}. Let 
V e End{S^) satisfy = V. Since V{Ei) C Ei for i = 1, 2, 4, we have 



V 



U 

u 



e B{H) for some U e B{K) 



We write 



for some A = {aij)ij, B = {hij)ij, C = {cij)ij, D = {dij)ij G B{K). We 
shall investigate the condition that V{Es) C E^. Since E3 — graph Z!y+ 
C(0, 0, 0, ei), E^ is spanned by 

/0\ 





{ 



/ 





7em-i 




/ \ 

e. 

\en+i ) 



-"n 






We may write 

/ (An)n \ 

V (a, {l^n)n) ) 

Since (ei, 0, 0, 0) G -E3, we have 







m 



2,3,...,n=l,2,...}. 



^3 = { 



G c, ^ |A„|^ < 00, < 00} 

n 



n 





5 





Q\ 


(eA 


(AeA 


( (Am)m \ 


c 













Ce, 










A 


B 










Vo 





c 




\V 


V 1 


\ (a, ()Um)m) / 



G ^3. 



Then, for any m = 1,2, ... , we have Cmi — /J'm — 0. Moreover = 
7Am+i + ^J'm = lXm+i. Heuce Am+1 = because 7 7^ 0. Therefore 
= ^m+i = 0. Thus the first column of C is zero and the first 
column of A is zero except an. We shall show that C — and A 
is an upper triangular Toeplitz matrix with by the induction of n-th 
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columns.® The case when n = 1 is aheady shown. Assume that the 
assertion hold for n-th columns. Since (e„-|_i, 0, 7e„, 0) G E^, we have 



/A 

C 




B 

D 

A 

C 



Then Cm,n+i = 
Since 7 7^ 0, 



0\ 


B 



( e„+i\ 


V / 



,n 



/ / (Am)m \ 



A, 



m+1 



0. And 'jam,n = T^m+l +IJ'm = 7Am+l- 

am+i,n+i- Thus we have shown that 



C = and A is an upper triangular Toeplitz matrix. Since V is an 
idempotent, so is 



U 



A B 
D 



Hence A is also an idempotent. By Lemma 110. If we have two cases 
A = OoT A = I. 

(i) the case A = 0: we shall show that B = D = 0. This immediately 
implies [/ = 0, so that = 0. 

(ii) the case A = I: Since I — V & End{S^) is is also an idempotent 
and it can be reduced to the case (i) and we have V = I. 

Hence we may assume that A = 0. Since U is an idempotent, D is 
also an idempotent. Since (0,0,0,ei) G -E3, we have 



/O 5 0\ 

L> 



\0 Q DJ 



/0\ 




\eij 



1,2, 



Then, for any m 
7A^+i + = and 



/ \ 


Bei 
\De,J 

we have ^„ 



( 



\ 



(Am)m 

m 

\ (a, {^im)m) I 



G E.. 



Xr 



0. Hence b. 



ml 



0. Thus the first column of B is 



zero and the first column of D is zero except dn. We shall show that 
D is an upper triangular Toeplitz matrix by the induction of n— th 
columns.® The case when n = 1 is already shown. Assume that the 
assertion hold for n—th columns. Since (0, e„, e„, Cn+i) G E3, 



fO B 0\ / \ 

D 

5 

\0 DJ 



Ven+i / 



/ Ben \ 

Den 
Ben+i 
\Den+i I 



(A 
(/i, 

y (a, {^iyn)m) I 



G E. 



We have (im+i,n+i = Atm = dmn- Hence D is an upper triangular 
Toeplitz matrix. Since D is also an idempotent, D = O 01 D = I 
by Lemma flO.ll 

If D = 0, then U = U"^ = 0. Thus B = 0, and the assertion is 
verified. We shall show that the case when D = I will not occur. On 
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V 



the contrary, suppose that D = I. We have 

/0\ /O 5 0\ /0\ / \ / (A^)^ \ 

0^0/00 0=0= (/^-)- 

S Bei hXm+l+f^m)m 

\eij \0 I J \eij \ei J \ {a,{iim)m) J 

Then, for any m — 1,2, ... , we have //^ = A„ = 0. Hence bmi — 

l^m+i + fJ'm = Thus the first cohimn of B is zero. We shall show that 
B should be the following form by the induction of n— th columns: 



B 



1^ 


1 





7 










7^ 





..A 








1 





7 























1 





7 





7^ 



















1 





7 





7^ 



















1 





7 

























1 





7 

























1 































1 

































V 


















■7 



that is, h. 



if otherwise. 



7"^" if J > i and j — i — 2k — 1, and 6^ 
The case when n = 1 is already shown. Assume that the assertion 
hold for n-th columns. Since 



/O 





for any m 



B 0\ 

10 

B 

1 



I 

1,2, 



/ \ 



\ 



( Am)m 
ra 

(7A^+i + //^) 

V (/^m)m) I 

m.n- And 



( Be,, \ 

\ en+1 / 
, we have //^ = 5„ 

= 7A^+1 + ^im — l^m+l + ^ m,n-i 

that is, 

{{n + l)-th column of B) — ^S*{n -th column of B) + e„. 
By the induction we have shown that B is the above form. But then 



\B*eif = ||(the first row of B)f = \j\ 



2(fc-l) 



= OO, 



k=l 



because |7| > 1. This contradicts to that B is bounded. Therefore 
D I. This finishes the proof. □ 

Theorem 10.3. // \/3\ > 1, |7| > 1 and \/3\ 7^ I7I, then the above 
systems Sp — {H; Ei, E2, E^, E4) and — {H; Ei, E2, Ej, E4) are not 
isomorphic. 
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Proof. On the contrary, suppose that there were an isomorphism V : 
Sp —>■ S^. We shall show a contradiction. We may and do assume that 
\P\ > |7|. Since V{Ei) = Ei for i = 1, 2, 4, we have 

^ " (o u) ^ ^^^^ ^^^^ invertible U e B{K) 



We write 



for some A = {aij)ij, B = {bij)ij, C 
We shall investigate the condition that V{E^ 
graph + C(0, 0, 0, ei), E'^ is spanned by 



(rf,,),, G B{K). 
= El Since E^ = 









( ° ^ 





















' 















V ) 




\en+i/ 







■,m — 2,3, . . . ,n 



1,2, 



We also write 



E"' 



{ 



\ 



(/^n)n 

ilK+l + fJ'n 
\ (a, (/^n)n) 

Since (ei, 0, 0, 0) e £'f , we have 



e C, ^ |A„|^ < oo, ^ < oo}. 



/A B 0\ 



C D 
A E 
C DJ 

Then, for any m = 1,2, ... , we have c 








Cei 


V J 



(-^m)m 
m 



eE2. 



ml 



0. Moreover 



m+1 • 



Hence A 



m+l 



because 7 7^ 0. Therefore 
cim+1,1 = A^+i = 0. Thus the first column of C is zero and the first 
column of A is zero except an. Since Aei ^ 0, an 7^ 0. We shall show 
that C = and A is an upper triangular matrix satisfying 



/5 
— ( 

7 



if i < j 



and = if i > j, by the induction of n-th columns.® The case 
when n = 1 is already shown. Assume that the assertion hold for n-th 
columns. Since (e„+i, 0, /3e„, 0) G E^, we have 



^El. 



(A 


B 





o\ 


( en+i\ 


/ Aen+i\ 




^ (Am)m 
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D 















i^f^m) m 










A 


B 


pen 


PACn 




(7-^^+1 + fJ^m] 
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\PCenJ 




\ (a, {l^m)m) 


J 
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Then we have c^.n+i = /^m = /5cm+i,n = 0. Moreover 

I3(lm,n = + /^m = = 7'^m+l,n+l- 

we have 



Since 7 7^ 0, am+i,n+i = ^o,m,,n- This completes the induction. Then 



arm = - an oo, 

7 

because an 7^ and |^| > 1. But This contradicts to that the operator 
A is bounded. Therefore and are not isomorphic. □ 

Next we shall show that if 7 > 1, then is not isomorphic to any 
closed operator system. We introduce a necessary criterion for the 
purpose. 

Definition(intersection diagram) Let S = {H; Ei, E2, E^, E4) be a sys- 
tem of fours subspaces. The intersection diagram for a system S is an 
undirected graph Ts = (F^, F^) with the set of vertices F^ and the set 
of edges F^ defined by F;^ = {1, 2, 3, 4} and for i j E {1, 2, 3, 4} 

Oj Oj if and only if EiCi Ej =0. 

Lemma 10.4. Let S = St,s = {H; Ei, E2, E^, E4) be a closed operator 
system. Then the intersection diagram for the system S contains 



O4 Ol O2 O3 , 

that is, E4^n El = 0, EiH E2 = and -E2 H -Es = 0. In particular, then 
the intersection diagram F5 is a connected graph. 

Proof. It follows form Proposition 18.91 □ 

Proposition 10.5. 1/7 > 1, then the system is not isomorphic to 
any closed operator system under any permutation of subspaces. 

Proof It is clear that E^n Ei = 0, EiD E2 = and n = 0. Since 
(ei, 0, 0, 0) G ^1 n E3, we have EiHE^^ 0. Because (0, 0, 0, 64) G ^2 n 
Es, we have ^2 fl i?3 7^ 0. Since I7I > 1, a := (1, 7"^, 7"^, 7"^, ) G 
Then (a, 0, a, 0) e E3 n E^, so that E3 n E^ ^ 0. Therefore 
the vertex 3 is not connected to any other vertices 1,2,4. Thus the 
intersection diagram F5 is not a connected graph. This implies that 
is not isomorphic to any closed operator system under any permutation 
of subspaces. □ 

Combining the preceeding two propositions , we have the existence of 
uncountably many, exotic, indecomposable systems of four subspaces. 

Theorem 10.6. There exists uncountably many, indecomposable sys- 
tems of four subspaces which are not isomorphic to any closed operator 
system under any permutation of subspaces. 

Proof. A family {5^; 7 > 1,7 G M} of indecomposable systems above 
is a desired one. □ 
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11. Defects for systems of four subspaces. 

Gelfand and Ponomarev introduced an integer valued invariant p{S), 
called defect, for a system S = {H; Ei, E2, E^, E^) of four subspaces by 

4 

p{S) = ^ dim - 2 dim H. 

i=l 

They showed that if a system of four subspaces is indecomposable, then 
the possible value of the defect p{S) is one of five values {—2, —1, 0, 1, 2} 
We shall extend their notion of defect for a certain class of systems 
relating with Fredholm index. 

Let S = {H; Ei, E2, E3, E4) be a system of four subspaces. We first 
introduce elementary numerical invariants 

rriij = dim{Ei fl Ej) and rriijk = dim(£'j fl Ej fl E^). 

Similarly put 

riij = dim((i?j + Ej)'^) and nij^ = dim((ii^j + Ej + E^)'^). 

If S is indecomposable and dim H > 2, then rriijk = and riijk = by 
Proposition 16.11 

If H is finite dimensional, then 

dim Ei + dim Ej — dim H 

= dim{Ei + Ej) + dim{Ei n Ej) - {dim{Ei + Ej) + dim{{Ei + Ej)^)) 

= dim{Ei nEj)- dim{{Ei + Ej)^) 

In order to make the numerical invariant unchanged under any per- 
mutation of subspaces, counting 4C2 = 6 pairs of subspaces 

{El, E2), {El, E3), {El, E4), {E2, Es), {E2, -E4), {E3, Ei), 

we have the following expression of the defect: 

4 

p{S) = ^ dim - 2 dim H 

i=l 

= - (dim Ei + dim Ej — dim H) 

l<i<j<4 

= 1 Yl idim{EinE,)-dim{{Ei + E,)^)). 

l<i<j<4 

Definition Let S = {H; Ei, E2, E^, E4) be a system of four subspaces. 
For any distinct i,j = 1, 2, 3, 4, define an adding operator 

Aij : Ei® Ej 3 {x,y) ^ x + y e H. 

Then 

Ker Aij = {{x, -x) E Ei ® Ej] x E Ei n Ej} 
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and 

ImAij = Ei + Ej. 

We say S = {H; Ei, E2, E^, E4) is a Fredholm system if Aij is a Fred- 
holm operator for any i,j = 1, 2, 3, 4 with i ^ j. Then ImAij = Ei + Ej 
is closed and 

Index = dimKei Aij -dimKer A* j = dim{EinEj)-dim{{Ei+Ej)-^). 

T. Kato called the number dim{Ei fl Ej) — dim((ii^i + Ej)-^) the index 
of the pair Ei, Ej in ([KJ;IV section 4). 

Definition We say S = {H; Ei, E2, E^, E4) is a quasi- Fredholm system 
if Ei n Ej and {Ei + Ej)-^ are finite-dimensional for any i ^ j. In the 
case we define the defect p{S) of S by 

p{S) -=1 n Ej) - dim{Ei + Ej)^)) 

l<i<j<4 

= - Y {dim{Ei nEj) - codimEj + Ej) 

l<i<j<A 

which coincides with the Gelfand-Ponomarev original defect if H is 
finite-dimensional. Moreover, if iS is a Fredholm system, then it is a 
quasi- Fredholm system and 

= ^ Index Ay-. 

l<i<j<4 

Proposition 11.1. Let St = [H; Ei, E2, E^, E4) be a bounded operator 
system associated with a single operator T G B{K). Then St is a 
Fredholm system if and only ifT and T — I are Fredholm operators. If 
the condition is satisfied, then the defect is given by 

p[St) = ^ (Index T + Index (T - /)) 

Similarly St is a quasi- Fredholm system if and only ifKeiT, KeiT*, 
Ker(T — /) and Ker(T — /)* are finte-dimensional. If the condition is 
satisfied, then the defect is given by 

p{St) = -(dimKerT — dimKerT* + dimKer(T — /) — dimKer(T — J)*) 
3 



Proof. It is clear that Ei (1 Ej = and Ei + Ej = H for {i,j) = 
(1,2), (1,4), (2, 4), (2, 3). Since KerAig = Ei n E3 = KerT © and 
(ImAia)-*- = {El + -Es)"*" = {K © ImT)^, they are finite-dimensional if 
and only if KerT and (ImT)-*- = KerT* are finite-dimensional. And 
Im Ai3 is closed if and only if Im T is closed. We transform E^ and i?4 

by an invertible operator R = ^ ^) ^ ^^^) ~ B{K © K) , then 
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R^Es) = {{x, (T - I)x) G K®K;x e K} and R{Ei) = K®0. Hence 
R{E3 n E^) = Ker(T - /) © and RiE^ + E^) = K ® Im(T - /). Then 



dim((E3 + ^4)^) = codim E^ + E^ 



= codim R{E3) + RiE^)) = dim{{R{E3 + E^))^) 

Thus i?3 n E4 and {E3 + -E4)"'" are finite-dimensional if and only if 
Ker(T — J) and (Im(T — /))-'" = Ker(T — /)* are finite-dimensional. 
And ImAi3 = E^ + E4 is closed if and only if Im{T — I) is closed. It 
follows the desired conclusion. □ 

We shall show that the defect could have a fractional value. 
Example. Let 5* be a unilateral shift on = £^(N). Then the opera- 
tor system Ss is an indecomposable. It is not a Fredholm system but a 
quasi- Fredholm system and p{Ss) = The operator system '5^+1/ 
is a Fredholm system and p{Sg_^_ij) = — |. Moreover {ST+ai)a£C is un- 
countable family of indecomposable , quasi-Fredholm systems. Fred- 
holm systems among them and their defect are given by 





(l«l 


< 1 and 


\a — 


1| 


<1) 




(l«l 


< 1 and 


\a — 


1| 


> 1) or ( a > 1 and \a — 1 






> 1 and 


\a — 


1| 


>1). 



p{Ss+ai) = \ — o, < 1 and |a; — 1| > 1) or {\a\ > 1 and |a; — 1| < 



Corollary 11.2. Let St = {H; Ei, E2, E^, E4) be a bounded operator 
system associated with a single operator T G B{K). If St is a Fredholm 
system, then St* is a Fredholm system and p{St*) = —p{St)- Similarly 
If St is a quasi-Fredholm system then St* is a quasi-Fredholm system 
and p{St*) = — p(iSt). 

Proof. Use the fact that T is Fredholm if and only if T* is a Fredholm, 
and then Index T* = — Index T. □ 

Proposition 11.3. Let S = {H; Ei, E2, E^, E4) be a system of four 
subspaces. If S is a Fredholm system, then the orthogonal complement 
S^ = {H; E^, E2, E^, E^) is a Fredholm system and p{S^) = —p{S). 
Similarly if S is a quasi-Fredholm system then S^ is a quasi-Fredholm 
system and p{S^) = —p{S). 

Proof. Recall elementary facts that E^ fl Ej- = {Ei + Ej)-^ and {E^ + 
Ej-)-^ = Ei n Ej. The only non-trivial thing is to know that Ei + Ej 
is closed if and only if E^- -\- Ej- is closed, see, for example, ([K]:IV 
Theorem 4.8). □ 

Example. For 7 G C with I7I > 1, let S^ = {H; Ei, E2, E^, E^) be 
an exotic system of four subspaces in Theorem 110.21 Then S^ is a 
quasi-Fredholm system and 

Pi^i) = ^(Index Ai3 + Index v423 + Index ^34) = ^(1 + 1 + 1) = 1. 
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In fact, El n = C(ei, 0, 0, 0), n = C(0, 0, 0, ei) and ^40^3 = 
C(a, 0,a, 0), where a = (7""-^)n e L = ^^(N). All the other terms are 
zeros. 

Definition. Let S — {H; Ei, E2, -E3, E4) be a system of four subspaces. 
We say that S is non- degenerate if E^ + Ej — H and E^ n Ej — for 
i 7^ j'. Then 5 is clearly a Fredholm system with the defect p{S) = 0. 
Thus the defect measures the failure from being non-degenerate. 

Proposition 11.4. Let S = {H; Ei, E2, Es, E^) be a system of four 
subspaces. Then S is non- degenerate if and only ifS-^ is non- degenerate. 

Proof. It follows from the fact that Ei+Ej = if if and only if E^CiEj- = 
0. □ 

Proposition 11.5. Let St,s be a bounded operator system. Then St,s 
is a Fredholm system if and only if S, T and ST — I are Fredholm 
operators. And if the condition is satisfied, then 

p{St,s) = ^ (Index T + Index 5 + Index(5r - /)). 

Proof. It is clear that E^ n Ej ^ and E^ + Ej ^ H for {i,j) = 
(1,2), (1,4), (2, 3). Since KerAis = EiHE^ = Kcr T©0 and (Im ^3)^ = 
(£"1 + E^)-^ = {Ki © ImT)-*-, they arc finite-dimensional if and only if 
KerT and (ImT)-*- = KerT* are finite-dimensional. And ImAi3 is 
closed if and only if Im T is closed. Similarly Ker ^424 = £'2 n £"4 = 
® Ker5 and (ImA24)^ = (^2 + -^4)^ = (Im5 © ^2)^. Hence they 
are finite-dimensional if and only if KcrS* and (ImS*)-*" = KerS"* are 
finite-dimensional. And Im ^424 is closed if and only if Im S is closed. 
Nextly, 

Ker A34 = £3 n £4 = {{x, Tx) eKi®K2;xe Kct{ST - I)}. 

Im^34 = { (^Tx + i) ; 3^ e ?/ e ^2} - (y) ' ^ ^ ^ 

Multiplying invertible operator matrices from both sides, we have 
7 -S\ (I S\ ( I 0\ _ (I -ST 0' 

Hence Im7434 is closed if and only if Im(S'T— /) is closed, and (Imy434)-'- 
is finite-dimensional if and only if (lm(5'T — /))-*- is finite-dimensional. 
Now it is easy to see the desired conclusons. □ 

Let S and S' be two quasi-Predholm systems of four subspaces. Then 
it is evident that <S © <S' is also a quasi-Predholm system and 

p{S®S')^p{S)-rp{S'). 

Therefore we should investigate the possible values of the defect for 
indecomposable systems. 
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Theorem 11.6. The set of the possible values of the defect of inde- 
composable systems of four subspaces is exactly Z/3 



Proof. Let S he a unilateral shift on L = £^(N). Let K 
H = K (B K. For a positive integer n, put 
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and 
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■■ 0\ 
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Vo 



G Mn{C)®B{L) = B{K). 



I sj 



Let Sv = {H; El, E2, E^, E4) be the operator system associated with 
a single operator V. We shall show that Sy is indecomposable. Let 
T = {Tij)ij G B{K) be an idempotent which commutes with V. It is 
enough to show that T = or T = /. 
Since VT = TV, we have 



STii — TiiS + T12, . . . STun-i\ (n-l)S + Tin, TinS — STi^. 

By the Kleinecke-Shirokov theorem, Ti„ is a quasinilpotent. Since Tin 
commutes with a unilateral shift S, Tin is a Toeplitz operator. Then 
ll^inll = r(Tin) = 0. Thus Ti„ = by [Ha3J . Inductively we can show 
that T12 = T13 = ■ ■ ■ = Tin = 0. Similar argument shows that T is a 
lower triangular operator matrix, i.e., Tij = for i < j. Since = T, 
we have T-^ = Ta for z = 1, ■ ■ ■ ,n. The diagonal of = TV shows 
that each Tu commutes with a unilatral shift S. This implies that 
Tii = or / as in Lemma flO. II 

(i) the case that Tu = 0: The 2-lth component of VT = TV shows that 
T22 = ST21 — T21S. Hence T22 cannot be I. Thus r22 = 0. Similarly we 
can show that Tjj = for i = 1, . . . , n. Thus the diagonal of operator 
matrix T is zero. Furthermore T is a lower triangular operator matrix 
and idempotent. Hence T = O. 

(ii) the case that Tu = T. Considering I — T instead of T, we can use 
the case (i) and shows that T = I. Therefore Sy is indecomposable. 

The defect is given by 



p{Sv) = -(dimKer \/ - dimKer \/* + dimKer(y - /) - dimKer(l^ - /)*) 
3 

1 — 71 

= -(0-n + 0-0) = — . 



-S 



*\7i— 1^ 



G {f.\N)r;ae Ker5™} 



In fact, 

KeiV* = {{a,-S*a,{-S*fa,... 

is n-dimensional. 

Similarly Sy* is an indecomposable system with p{Sv*) = f . 

For n = 0, consider an indecomposable system Ss+31 as in Example 
after Proposition lll.il Then p{Ss+3i) = 0. 
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Therefore the defect for indecomposable systems of four subspaces 
can take any value in Z/3. □ 



Remark. Indecomposablity of the system Sy can also be derived by 
Theorem 3.4 in jJWj, although we give our direct proof. 

Corollary 11.7. For any n G Z there exist uncountable family of inde- 
composable systems S of four subspaces with the same defect p{S) = |. 

Proof. For a positive integer n, consider a family {Sv+ai)a€io,i) and 
{Sv*+ai)a<^(o,i) of bounded operator systems similarly as in the above 
theorem. Then any Sy+ai is also indecomposable and 

1 — Tl 

p{Sv+ai) = -{0-n + 0-0) = —. 

If a 7^ /5, then the spectrum a(y + al) ^ a(y + 131) . Since V + al 
and V + (31 are not similar, Sy+ai and Sv+pi are not isomorphic each 
other. 

We also have p{Sy*+ai) = f they are not isomorphic each 
other. 

For n = 0, consider a family {Ss+'ii+ai)a&[Q,i] in Example after Propo- 
sition 8.5. They are indecomposable , not isomorphic each other and 

p{Ss+ZI+al) =0. □ 



12. COXETER FUNCTORS 

In ICjPj Gelfand and Ponomarev introduced two functors and 
$~ on the category of systems S oi n subspaces in finite-dimensional 
vector spaces. They used the functors and to give a complete 
classification of indecomposable systems of four subspaces with defect 
p[S) 7^ in finite-dimensional vector spaces. If the defect p{S) < 
0, then there exists a positive integer ^ such that ($^)^~^(iS) 7^ 
and (<l>+)^(5) = 0. Combining the facts that indecomposable systems 
T with $+(T) = can be classified easily and that S is isomorphic 
to (and recovered as) they provided a complete 

classification. A similar argument holds for systems S with defect 
p{S) > 0. 

In their argument the finiteness of dimension is used crucially. In fact 
if an indecomposable system S = [H; Ei, E2, E^, E4) with dim/7 > 1 
satisfies that the defect p{S) < 0, then $+(5) = {H+; Ef, E^, E^, Ef) 
has the property that dim if"*" < dim if. The property guarantees the 
existence of a positive integer C such that ($"'")^(iS) = 0. Although 
we can not expect such an argument anymore in the case of infinite- 
dimensional space, these functors and $~ are interesting on their 
own right. Therefore we shall extend these functors and $~ on 
infinite-dimensional Hilbert spaces and show that the Coxeter functors 
preserve the defect and indecomposability under certain conditions. 

35 



Definition. (Coxeter functor $"*") Let Sys^ be the category of the 
systems of n subspaces in Hilber spaces and homomorphisms. Let 
S — {H; E-i,..., En) be a system of n subspaces in a Hilbert space H. 
Let R := e"=i-Bi and 

n 

T : R3 X = {xi, . . . , Xn) I — > t{x) = Xi e H. 

i=l 

Define S+ = {H+; , . . . , E+) by 

:= Kerr and := {{xi, . . .,Xn) G H^;Xk = 0}. 

Let T = {K; Fi, . . . , En) be another system of n subspaces in a Hilbert 
space K and (p : S ^ T he a homomorphism. Since cp : H ^ K is a 
bounded hnear operator with (p{Ei) C Fj, we can define a bounded hn- 
ear operator (p~^ : — * by (p~^{xi, . . . , a;„) = {(p{xi), .... ip{xn)). 
Since ip~^{E^) C F^"*", (z?"*" define a homomorphism y?"^ : 5^ — > T"*". Thus 
we can introduce a covariant functor : Sys" — > i^i/s" by 

$+(5) = 5+ and = ip+. 

Example.If <S = (C; C, C, C), then S+ ^ (C^; C(l, 0), C(0, 1), C(l, 1)). 

Lemma 12.1. Let S — {H; Ei, E2, E^, E4) be a system of four sub- 
spaces and consider S'^ — [H^] E^, E2, E^, E^) ■ Then 

Et n Et = {(0, 0, a, -a) e ^Ui^i] aeEsD E^}. 

In particular, we have dimF^ fl E2 — dimFs fl E4. Same formulae 
hold under permutation of subspaces. 

Proof. Let x = (xi, X2, X3, X4) e E^ fl E2, then xi — X2 — 0. Since 

X G H~^, r(x) = X3 + X4 = 0. Thus a := x^ = —X4 G E3 H E4 and 
X = (0, 0, a, —a). The converse inclusion is clear. □ 

Lemma 12.2. Let S = {H; Ei, E2, E^, E^) be a system of four sub- 
spaces and consider S+ = {H+ ; E^ , E^ , E^ , Ef) . If E^nE^ = {) 
and E3 -\- E4 = H, then E^ + E2 = . Same formulae hold under 
permutation of subspaces. 

Proof. Let z — {zi, Z2, Z3, Z4) G H'^. Put yi :— z\ and X2 '■= Z2. Since 
E3 -\- E4 — H, there exist y^ G E^ and y^ G £'4 such that —yi — 
y3 + yi. Since y^ + y-^ + y^ = 0, y ■= (1/1,0,1/3,1/4) G H+. Similarly 
there exist x^ G E^ and X4 G F4 such that —X2 = x^ -\- X4^, so that 
X := {0,X2,X3,X4) G 

Since 2; G H^, Zi -\- Z2 + Z3 -\- Z4 — 0. Hence 

Z3 + Z4^ -zi - Z2^ -yi - y2 

= iUs + Vi) + {X3 + Xa) = {x3 + ys) + (0:4 + 1/4) G F3 + F4. 

Because £"3 n F4 = 0, we have Z3 = X3-\- 1/3 and 2:4 = 0:4 + 1/4. Therefore 
2; = x + y G -Eg^ + -E;^. □ 
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Example. Let Ss^t = {H; Ei, E2, -E3, -E4) be a bounded operator sys- 
tem. Combining the preceding two lemmas Lemma 112.11 and Lemma 
112.21 with a characterization of bounded operator systems in Corollary 
18.111 we have that = {H^; Ef, E^ , E^, E^) is a bounded operator 
system up to permutation of subspaces. More precisely, {H~^; E^, E^, 
E^, E2) is a bounded operator system. 

Let © © := © ■ • ■ © © © © ■ ■ ■ © C and G B{R) 
be the projection onto © Ej © 0. Let : ^ R he a. canonical 
embedding. Then we have an exact sequence: 

Furthermore we have 



Kerrgj = Kergj, Ei = Imrgj = Imrgj and E^' = KergjZ_|_. 

These properties characterize = {H^; E^, E2, E^, E^) . 

Proposition 12.3. Let X, Y and Z be Hilbert spaces and T : X ^ Y 
and S : Y ^ Z be bounded linear maps. Suppose that a sequence 

— > X ^Y ^ Z. 

is exact. Let pi,...,pn G B{Y) be projections with ^^Pi = I and 
PiPj = for i ^ j . Furthermore we assume that 

Kei S Pi = Ker Pi and ImSpi is closed in Z. 

Let Ei := Im Spi C Z and E'i := KerpjT C X . Define S = {Z; Ei, . . . , E^] 
and S' = {X;E[,..., E'J. Then S' ^ $+(5) 

Proof. Consider the restriction Si := S\i^p. : Impj — >• ImSpi. Since 
Ker Spi = Ker Pi, Si is one to one. Because ImSpi is closed, ImSpi 
is complete. Therefore Si is an invertible operator by open mapping 
theorem. Define : Y = ©^^^Imp^ ©Li^i by ^{{yi)i) = {Si{yi))i 
for {yi)i e ©"^^ Im Then ip is an invertible operator. Consider r : 
(B2=iEi — Z given r((zj)i) = ^"^^ Zi. Let Z~^ = Kerr and : Z~^ — > 
(B2=iEi be a canonical embedding. Then Tip = S. Define ip : X ^ Z^ 
by ip{x) = <pT{x) for x G X. The map ip is well-defined, because 
t{iP{x)) = T{ipT{x)) = ST{x) = 0. Then the following diagram 

> X Y Z 



idz 



. Z+ ©tiE, 



is commutative. Furthermore maps ip and ip are invertible operators. 
Let qi G B{®'^^iEi) be a projection onto © Ej © 0. Then qi = (ppiip~^, 
E^ = Ker(gjZ+) and E'i = Ker(pjT). Therefore ip{Ei) = E^. Thus 
Ip : S' ^ ^^{S) is a desired isomorphism. □ 
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Definition. (Coxeter functor $~) In |GPj Gelfand and Ponomarev in- 
troduced a dual functor $~ using quotients of vector spaces. If H 
is a Hilbert space and K a subspace of H, then it is convenient to 
identify the quotient space H/K with the orthogonal complement K^. 
Therefore we shall generalize their functor $~ in terms of orthogonal 
complements instead of quotients in our case of Hilbert spaces. Let 
S = {H; El, ... , En) be a system of n subspaces in a Hilbert space H. 
Let ej- e B{H) be the projection onto E^- C H. Let Q := &i=iEl and 

jjL : H 3 X I — ^ = {e^x, . . . , e^x) E Q. 

Then jj* : Q ^ H is given by . . . , y^) = XlLi Vi- Define H' := 

Ker /i* C Q. Let 2„ : /J^ ^ Q he a canonical embedding. Then 
q- := t*_ : Q ^ R- is the projection. Let © © := © ... © 
© ■ ■ ■ © C Q and G ^(Q) be the projection onto Q ® E^ ® 0. 
Define 5" = {H-, E^ , . . . , E') by 

:= ?-(0 © © 0) = Img_ri C if". 

We note that 

H- := Ker/i* = Q n (Im/i)^ = Q/ET^. 
We have an exact sequence 

— > H- ^ Q ^ H 

and a sequence 

H JUq^H- — > 0, 

satisfying that Im /i = Ker g_ and g_ is onto. Thus it is easy to see that 
our definition of = {H~] E^ , . . . , E~) coincides with the original one 
by Gelfand and Ponomarev up to isomorphism in the case of finite- 
dimensional spaces. 

Define := = {H^; E^ , . . . , E^). Then there is a relation 

between and S~ . We recall some elementary facts first. 

Lemma 12.4. Let H and K he Hilbert spaces and M a closed subspace 
of H. Let T : H K be a bounded operator. Consider T* : K H . 
Then T{M^) = {{T*)-\M))^ C K. 

Lemma 12.5. Let L be a Hilbert space and M, K closed subspaces 
of L. Let Pk G B{L) be the projection onto K. Then Pk{M^) = 

Kn{KnM)^. 

Proof. By the preceding lemma, 

(Pk(M^))^ = Pk\M) = {xeL; Pkx E M}. 

Decompose x E L such that x = Xi + X2 with xi E K, X2 E K^. 
Then Pkx G M if and only if xi G M. Therefore (P^(M^))^ = 
{KnM)+ K^. Thus Pk{M^) = Kn{Kn M)^. □ 
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Proposition 12.6. Let S = {H; Ei, . . . , E^) he a system ofn subspaces 
in a Hubert space H . Then we have 

$-(5) = $^$+$^(5). 

Proof. Since ^^{S) = {H; E^, ...,E^),we have 

^^^^{S)^{H';{E^)\...,iE^r), 

where = {(yi, ...,?/„) e 0^=1^;^; ?/i H h ?/n = 0}. Therefore we 

have H' = H-. 

Applying the preceding Lemma by putting L = (B'^^^E^, M = 
{{yi, ■ ■ ■ ,yn) ^ L;yk = 0} and K = C L, we have 

E- = g_(0 © E^ © 0) = Pk{M^) =Kn{Kn M)^ = H-n{{Ei)+)^. 

Therefore (E^)^ = {E^)+ in R-. Hence $^$-(5) = $+$^(5). This 
implies the conclusion. □ 

Let S = {H; El, . . . , En) be a system of n subspaces in a Hilbert 
space H and T = {K; Fi, . . . , F„) be another system of n subspaces 
in a Hilbert space K. Let </? : <S — > T be a homomorphism, i.e., 
(/? : if — > X is a bounded linear operator with (p{Ei) C Fj. Define 
(f- : $-(5) ^ $-(r) by 

Thus we can introduce a covariant functor $~ : »Sys" — > <Sys" by 
$-(<S) = 5- and $-(99) = ip-. 

Remcirk. Let <S = {H;Ei, . . . ,En) be a system of n subspaces in 

a Hilbert space H. Let R := (B^^iEi and t : R ^ H is given by 
t{x) = '^i^iXi. Let := Kerr and qo : R ^ be the canonical 
projection. Define E° := go(0©Ffc ©0). Let 5° := F?, . . . , 
and = 5°. Then we have 

$+(5) = and ^-{S) = 

Furthermore 

$-$+(5) = i^yiS) and $+$-(5) = 
Suppose that H is finite-dimensional. Then 

dim — dim Ker r = dim R — dim Im r = dim £'j — dim(^^ Ei) 

i i 

In particular, if iS = {H; Ei, E2, E^, E4) is an indecomposable system 
of four subspaces with dim if > 2, then dim if ° = dim£^j — dim ii" 
and the defect 

p(S) = ^ dim - 2 dim H = dim H° - dim H. 

i 
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We shall characterize $^(5). The following fact is useful: Let H and 
K be Hilbert spaces and T : H ^ K he a. bounded linear operator. 
Then ImT is closed in K if and only if ImT* is closed in H. 

Proposition 12.7. Let U, V and W be Hilbert spaces and A : U —>■ V 
and B : V ^ W be bounded linear operators. Suppose that a sequence 

U -^W — >0 

is exact. Let G B(y) be projections with J2iPi — ^ ^''^^ 

PiPj = for i j . Furthermore we assume that 

ImpiA is closed in V and ImpiA = Impj. 

Let L[ := Im Bpi C W and Li := KeipiA C U. Define S = {U; Li, . . . , L^) 
and S' = {W; L[, ...,L'„). Then S' ^ $-(5) 

Proof. Since ImB = W is closed, ImB* G V is also closed. Then 

ImB* = (KeiB)^ = (ImA)^ = Kei A* 

and Keri?* = (ImB)-^ = W-^ = 0. Hence the dual sequence 

— >w 

is exact. We shall apply Proposition 112.31 by putting X = W, Y = V, 
Z = U, T = B* and S = A*. We can check the assumption of the 
Proposition. In fact, 

Kei S Pi = Kei A* Pi = (ImpiA)'^ = (Impj)"*" = Kerpj, 

and Im Spi = Im A*pi = lm{piA)* is closed, because lm{piA) is closed. 
Let 

Ei := ImSp, = lm{p,Ay = (Kerp.A)^ = (L,)^ C U 

and 

E'- := Kei piT = Ker piB* = (ImBpi)^ = {L[)^ C W. 
Then (X; . . . , E'^) = <I>+(Z; Ei, . . . , E„), that is, we have 

{W- {L[)\ . . . , (LX) = <^HU; {L,)\ . . . , (L^). 

Thus {SY = $+(5^). Hence 

□ 

Proposition 12.8. Let S and T be systems of n subspaces in a Hilbert 
space H. Then we have $+(5 © T) = $+(5) © $+(T), 

$-(5 © T) = $-(5) © $-(T), and $^(5 © T) = $^(5) © $^(r). 

Proof. It is straightforward to prove them. □ 
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Definition. Let S = {H; Ei, . . . , E^) be a system of n subspaces in a 
Hilbert space H . Then S is said to be reduced from above if for any 
/c = 1, . . . , n 

Y,E, = H. 

In particular we have E}^ C Yli=ik-^i- Similarly S is said to be reduced 
from below if for any k = 1 , . . . , n 

In particular we have E^ C J2i^k ^^"^ (^i^kEi = 

It is evident taht iS © T is reduced from above if and only if both S 
and T are reduced from above. Similarly iS © T is reduced from below 
if and only if both S and T are reduced from below. 

Example. (1) Any bounded operator system is reduced from above and 
reduced from below. In fact Ei + E2 = H, Ei + E4 = H , E2 + E^ = H 
and E^ + E^ = H, E^ + E^ = H, E^ + Ei = H. 
(2) The exotic examples in section 10 are reduced from above and re- 
duced from below. 

We shall show a duality theorem between Coxeter functors and 

Theorem 12.9. Let S = {H; Ei, . . . , En) be a system of n subspaces 
in a Hilbert space H . Suppose that S is reduced from above. Then we 
have 

$"$+(5) ^ S. 

Proof. Let R = ©"^^i^j. Consider a sequence 

H+ ^R^ H — >0. 

Since S is reduced from above, Imr = Yll=i = Thus the above 
sequence is exact. Let pi G B{R) be the projection onto © © 0. 
We shall apply Proposition 112.71 bv putting U = V = R, W = H, 
A = Ij^ and B = r. We can check the assumption of the proposition. 
In fact, since S is reduced from above, for any Xk € -Efc, there exist 
Xi E Ei ioT i k such that x^ = J^i^tk Then J2i=i — 0' ^^^^ i^, 
X := {xi)i G H^. Then 

PkA{x) = 0®Xk®OeO®Ek®0. 

Thus ImpkA = © -Efc © = Impfc and Imp^^ is closed. Therefore 
{W;L[,...,L'J = <^-{U-L,,...,Ln) . Since 

= Im Bpk = Im rpk = E^ 
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and 

Lfc = KerpkA = KeTpki+ = E^, 

we have 

S = {H;E,,..., En) = <f-(i^+; Et, ...,EX) = $"$+(5). 

□ 

Similarly we have the follwoing: 

Theorem 12.10. Let S = (if; Ei, . . . , En) be a system of n subspaces 
in a Hubert space H . Suppose that S is reduced from below. Then we 
have 

Proof. If S is reduced from below, then S-^ is reduced from above. 
Hence $-$+(5^) = S^. Then 

□ 

@ 

Proposition 12.11. Let S = {H; Ei, . . . , E^) be a system of n sub- 
spaces in a Hubert space H. Then ^^{S) = if and only if for any 
k = 1, . . . ,n 

Ekn{J2E^)^o. 

Proof. It is easy to see that $'''(5) = if and only if for any Xi e Ej, 
with i — 1, . . . ,n ^jXj = imples Xi = ■ ■ ■ — Xn = 0- The latter 
condition is equal to that E^ fl (X^j-^^ Ej) — for any k = 1, . . . ,n. □ 

The above conditon Ek fl (Yli^kEi) = for any k = is 
something like an opposite of that S is reduced from above. 

Proposition 12.12. Let S = {H; Ei, . . . , En) be a system of n sub- 
spaces in a Hilbert space H . Then $^(5) = and Y^^=i closed in 
H if and only if {H; Ei, . . . , En, {Y17=i ^i)^) ^■^ isomorphic to a system 
of direct sum decomposition, that is, there is an orthogonal direct sum, 
decomposition K = (B^^iKi of a Hilbert space K and (H; Ei, . . . , En, 
iYli=i ^i)^) '^^ isomorphic to a system {K; Ki, . . . , Kn+i), in particular 
S is isomorphic to a commutative system. 

Proof. Assume that = and Yl^=i closed in H. Let En^^i = 

(Er=i Ei)^- Let R — ®UiEi and Ki := 00- • -^O^Ei^O®- ■ -©0 C R. 
Define Lp : K ^ H hj ip{{xi)i) = Yli^i- Then the bounded operator (/? 
is onto, because Y17=i is closed in H. Since $^(5) = 0, (p is one to 
one by the preceding proposition. It is clear that ^{Ki) = E^. Hence 
[H; El, . . . , En+i) is isomorphic to [K; Ki, . . . , Kn+i)- The converse 
and the rest are trivial. □ 
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Example. Let T G B{K) be a positive operator with dense range and 
ImT j^K. Let H = K Q) K, El = K Q) and E2 = graphT. Put S = 
[H; El, E2). Then $+(5) = and {Ei + E^)^ = 0. But {H; Ei, E2, 0) 
is not isomorphic to a system of direct sum decomposition. In fact 
El + E2 = K ®lmT is not closed. 
We also have the following: 

Proposition 12.13. Let S = {H; Ei, . . . , En) be a system of n sub- 
spaces in a Hubert space H Then $^(5) = if and only if for any 
k = 1, . . . ,n 

EiniJ2E^) = o. 

Proposition 12.14. Let S = {H; Ei, . . . , En) be a system of n sub- 
spaces in a Hubert space H. If S is reduced from above and S 0, 
then ^~^{S) 7^ 0. Similarly if S is reduced from below and S 0, then 
$-(5) 0. 

Proof. Suppose that Ei = for any i = 1, . . . , n. 

Theni7 = Er=i = 

0. This contradicts to that 5 7^ 0. Therefore Ek for some k. Since 
J2i=ik ~ f*^^ ^ non-zero Xk E Ek, there exist Xi E Ek for i y^ k such 
that —Xk = Xli^o^*- Therefore x := (xi,...,x„) G is non-zero, 
that is, $''"(5) 7^ 0. The other is similarly proved. □ 

Remark. By Proposition l6.11 if a system of n subspaces S = {H; Ei, . . . 
En) is indecomposable and dim if > 2, then for any distinct n-1 sub- 
spaces Ei-^ , • • • , -£'i„_i , we have that 

n— 1 71—1 

fl E,, = and V E,^ = H, 



k=l k=l 



that is, 



71—1 n— 1 

Y,E^^ = H and Y,E.,=H, 

k=l k=l 

Unless H is finite-dimensional, these conditions seems to be weaker 
than that S is reduced from below and above. 

Remark. Let S = {H; Ei, . . . , En) be a system of n subspaces in a 
Hilbert space H and consider = [H^; Ei , . . . , E^). Then for any 
distinct n-1 subspaces E^, . . . , E^__^, we have that 

n-1 

n K = 0. 

fc=i 

In fact, for example, let {xi, . . . , Xn) G CY^^iE^. Then xi = X2 = ■ ■ ■ = 
Xn-i = 0. Since (a;i,...,x„) G , we have YM=i^k = 0. Hence 
Xn = 0. Thus n^zlE^ = 0. 
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On the other hand the above condition imphes that 



n-l 
k=l 

This condition is a httle weaker than that is reduced from below 
unless H is finite dimensional. 

Conider S~ = $^$'^'$-'-(5) similarly. Then we have 

k=l 

The condition is a little weaker than that is reduced from above 
unless H is finite dimensional. 

Theorem 12.15. Let S = {H; Ei, . . . , En) be a system of n subspaces 
in a Hubert space H . Suppose that S is reduced from above and = 
$"'"(5) is reduced from below. If S is indecomposable, then $^(5) is 
also indecomposable. 

Proof. On the contrary suppose that were decomposable. Then 
there exist non-zero systems Ti and 7^ of n subspaces such that = 
T1Q1T2. Since S is reduced from above, 

s ^ $-$+(5) = <i>-(Ti) © $"(ri), 

by a duality Theorem 112.91 Since = $^(5) is reduced from below, 
7i and T2 are also reduced from below. By another duality Theorem 
imm $+$-(7;) = 7; for i = 1,2. Since 7^ ^ 0, we have $-(7^) ^ 0. 
(We could use Propsition [T21 instead.) This implies that S is decom- 
posable. This is a contradiction. Therefore is indecomposable. □ 

Example. Let = [H; Ei, E2, E^, E4) be an exotic example in section 
10. Since Ei + Ej = H and Ei f] Ej = for distinct i,j G {1, 2, 4}, we 
have E^+E:^ = H and E^nE+ = for distinct k,m e {3, 4} or k,m e 
{1,3} or /c, m G {2,3} by Lemma Il2.ll and Lemma 112.21 Since E^ + 
E+ = H is closed, + is closed. Hence {E+)^ + {E+)^ = H 

Therefore S-y is reduced from above and $"'"(iS^) is reduced from below. 
Since S-y is indecomposable, $"^(iS^) is also indecomposable. 
Similarly we have the following: 

Theorem 12.16. Let S = {H; Ei, . . . , En) be a system of n subspaces 
in a Hubert space H . Suppose that S is reduced from below and = 
$~(iS) is reduced from above. If S is indecomposable, then $^(5) is 
also indecomposable. 

We shall show that the Coxeter functors $^ and $^ preserve the 
defect under certain conditions. 
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Let S = {H; Ei, . . . , En) be a system of n subspaces in a Hilbert 
space H. Consider 5+ = {H+] E+, ...,E+). Let R = ^'l^^Ei and po e 
B{R) be the projection of R onto Let e -B(-f^) be the projection 
of H onto Ei. Recall that r : R ^ H is given by r{a) — Yl^=i 
a = (oi, . . . , Qn) e R. 

Lemma 12.17. Suppose that Yli=i^i invertible. Then for a — 
(oi, . . . , a„) & R we have 

n 

Po{a) = {uk - euC^ ei)"^(r(a)))fe e 

i=l 

Proof. Recall that t* : H ^ R\s given by t*(|/) = (eiy, . . . , e„y) for 
y E H. Consider the orthogonal decomposition R — © [H^)-^. 
Since — Kerr, [H^)-^ — Imr* in R. Define 

n 

X = {xk)k ■= (ofe - efe(X] ei)"^(T(a)))fe e i?. 

i=l 

Then 

n n rt n 

r(x) = 5;(a,-e,(5]e,)-^(r(a))) =r(a)-(5]e,)(^e,)-^(r(a)) = 0. 

fe=l i=l fe=l i=l 

Therefore x e Put y := (Er=i ^ H. Then r*(|/) = 

(eii/, . . . , eny) e Since a ^ x + T*{y) e ® {H+)-^, we have 

Po(a) = X. □ 

Corollary 12.18. Suppose that Cj Z5 invertible. Then Imr* 
closed and 

{H+)^ = Imr* = {(eiy, . . . , e„y) e i?; y G H}. 
Proof. By the above lemma, we have 

{H+)^ = Im(J - po) = {(ei2/, • • • , e^y) e R;y E H} ^ Imr*. 

□ 

Lemma 12.19. Let S — {H; Ei, . . . , En) be a system of n subspaces 
in a Hilbert space H. Let e^ e B{H) be the projection of H onto E^. 
Then 

j^E,^lm{(£eif'% 

i=l i=l 

Moreover Yll^=i closed if and only if Y17=i ^ closed range. 
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Proof. See Filmore and Williams |FWj for several facts on operator 
ranges. Let T = {Tij)ij G B{H^) be an operator matrix defined by 
Tij = ej and Tij = for z ^ 1. Recall that ImT = lm{{TT*y/^) for 
any operator T. Since ImT = (^"^^ Ei)©0©0©0 and Im((TT*)i/2) = 

(Im((Er=i © © © 0, we have Zti = Im((Er=i e^f'^)- 

It is a known fact that Im A is closed if and only if Im A^/'^ is closed 
for any positive operator A G B{H). This implies the rest. □ 



Corollary 12.20. Let S = {H; Ei, . . . , En) be a system of n suhspaces 
in a Hilhert space H . If S is reduced from above, then f := Yl'i=i ^■^ 
invertible. 

Proof. Let x G Ker /. Then {eix\x) = so that CiX = 0. Since S is 
reduced from above, x G f^iE^- = Thus Ker / = 0. Then Im / = 
(Ker/)-*- = H. Since S is reduced from above, J2^=i Ei = H is clearly 
closed. By the preceding lemma, / has a closed range. Thus lmf = H. 
Therefore / is invertible. □ 

Lemma 12.21. Suppose that S is reduced from above. Then for k = 
1, . . . ,n 

n 

{E+)^ = {{5jkaj - CjiY^ ei)-\ak))j G H+; G EJ. 

i=l 

Proof. Since S is reduced from above, we have Imp^Po = © Ek®. In 
fact, for any G Ek, there exist G Ei,{i ^ k) such that — = 
Xlj^fc ^i- Then (ai, . . . , a„) G and 

PkPoiai, . . . , a„) = (0, . . . , 0, ttfc, 0, . . . , 0) G © Efc © 0. 

The converse inclusion is trivial. Since Imp^po = © Ek® is closed, 
{ImpkPoY = ImpoPfc is also closed. Hence 

{E+)^ = El = ImpoPfc = {po(0, . . . , 0, afc, 0, . . . , 0); afc G Efc} 

Therefore the conclusion follows from Lemma 112.171 . □ 

Proposition 12.22. Let S = {H; Ei, E2, E^, E4) be a system of four 
subspaces and = {H~^; Ef, E2, Ef, E^) . Suppose that S is reduced 
from above. Then / := ei + 62 + 63 + 64 is invertible and 

(Et)^ n (E^)^ 

= {(eiM - ei/^^eiM, -Ca/^^eiw, -eg/^^ciw, -e4f'^eiu);u e E^ n E^}. 

Moreover we have 

dim((E+)^ n (^2^)^) = dim(E3^ n ^4^). 

The same formulae hold under permutation of subspaces. 

46 



Proof. Let a; = (xi, 0:2, 2:3, ^4) G {E^)-^n{E2 )^- Then by the preceding 
lemma, there exist ai G Ei and 02 G E2 such that 

= (oi - ei/~^ai, -ea/^^ai, -eg/'^ai - e4/"^ai) 
= (-61/^-^02, 02 - e2/"^a2, -e3/"^a2 - e4/"^a2). 

Put It := f'^idi — CI2) G -f^- Then Oi = Ciii, 02 = —621*, 63!^ = and 
64 w = 0. Therefore u G -E^ fl and 

X = (eiit - ei/^^eiit, -e2/~^eiii, -e^f~^eiu, -e4f~^eiu). 

Conversely suppose that 

X = {eiu - eif^^eiu, -e2f'^eiu, -esf'^eiu, -e^f'^eiu), 

for some u G E^ n E^. Put ai eiU G £^1 and 02 := —621* G £^2- 
Since e^u = and e^u = 0, we have 

ai — a2 — eiu + e2U — eiu + e2U + e^u + e^u = fu. 

Because / is invertible, u — f~^{ai — 02). Therefore 

X = (ai - ei/~-^ai, -e2/~^ai, -esf'^ai - e^f'^ai) G (E^)-^. 

On the other hand, oi = eiu = ei/~^(ai — 02). Hence 

ai - ei/^^ai = -ei/~^a2. 

Since 02 = —621* = —^2f~^{0'i — 02), we have 

-62/^^01 = 02 - e2/~^a2. 

Since 63/""^ (ai — 02) = 631* = 0, we have e^f'^ai — e^f~^a2. Similarly 
tif'^ai — 64/^^02 . Therefore 

X = (-61/^^2, 02 - 62/^^02, -e^f~^a2 - 64/^^2) e (£2^)"^. 

Thus a; G (£1+)^ n (£2^)^. 

Moreover define T -.E^HEi ^ {Ef)^ n (£^)^ by 

Tu = {eiU - eif'^eiu, -62/^^61^, -e^f'^eiu, -e^^f-^Ciu) 

for u G £^ n E'^j^. Then T is a bounded, surjcctivc operator. We shall 
show that T is one to one. Suppose that Tu = 0. Since e2f^^eiu = 0, 
/"^Ciu G -B^. Similarly /"^eiu G -B^^ and /"^eiu G -B^. Since S is 
reduced from above, 

f-^eiu G £2^ n £3-^ n £f = (£2 + £3 + £4)^ = //^ = 0. 

Hence CiU = 0. Similary we have e2U = 0. Therefore fu = CiU + e2U + 
e^u + e4ii = 0. Since / is invertible, u — Thus T is an invertible 
operator. Therefore dim((£;+)^ n {E^)^) = dim(£;^ n S^). □ 
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Theorem 12.23. Let S = {H; Ei, E2, E^, E4) be a system of four sub- 
spaces. Suppose that S is reduced from above. If S is a quasi- Fredholm 
system, then ^~^{S) is also a quasi- Fredholm system and 

p($+(5))=p(5). 

Proof. It follows from Lemma 112.11 and Proposition 112.221 . □ 

Theorem 12.24. Let S = {H; Ei, E2, -E3, E4) be a system of four sub- 
spaces. Suppose that S is reduced from below. If S is a quasi- Fredholm 
system, then ^~{S) is also a quasi- Fredholm system and 

p{^-{S))=p{S). 

Proof. Recall that S is reduced from below if and only if $"'"(5) is 
reduced from above, and iS is a quasi- Fredholm system if and only if 
$"'"(iS) is a quasi- Fredholm system. Applying the preceding theorem, 
$~(iS) = $-'-$+$-'-(iS) is a quasi- Fredholm system and 

= -p(<|.+$^(5)) = -p($^(5)) = p{S). 

□ 

Example. Let S be an operator system. Since Ei = K(BO, E2 = 0(BK, 
we have that / = 'Y2t=i > / is invertible. Moreover ii S = St is 
associated with a single bounded operator T, then E4 = {{x,x) G 
H;x e K}. Thus Ei + Ej = H for {i,j) = (1,2), (1,4), (2,4) and S 
is reduced from above. Therefore, if St is a quasi- Fredholm system, 
then ^~^{St) is also a quasi- Fredholm system and p($"^(5r)) = pi^r)- 
Similarly, let S^ be an exotic example in section 10. Then 5^ is reduced 
from above and / is invertible. S ince S.y is a quasi-Fredholm system, 
$"'"(5^) is also a quasi-Fredholm system and p($"^(5^)) = p{S^). 
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